-- Logs begin at Wed 2022-07-13 08:16:21 UTC, end at Wed 2022-07-13 09:25:09 UTC. -- Jul 13 08:56:55.596770 dv-cinder-849626-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 13 08:56:55.604898 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 08:56:55 2022] *** Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: nodename: dv-cinder-849626-3-iscsi Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: machine: x86_64 Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: clock source: unix Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: pcre jit disabled Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: detected number of CPU cores: 4 Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: current working directory: / Jul 13 08:56:55.606894 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: detected binary path: /usr/bin/uwsgi-core Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: your processes number limit is 47680 Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: your memory page size is 4096 bytes Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: detected max file descriptor number: 2048 Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: lock engine: pthread robust mutexes Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: thunder lock: enabled Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 13 08:56:55.608066 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 08:56:55.651389 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: Python main interpreter initialized at 0x56519277e9c0 Jul 13 08:56:55.651389 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: python threads support enabled Jul 13 08:56:55.651389 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: your server socket listen backlog is limited to 100 connections Jul 13 08:56:55.651389 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: your mercy for graceful operations on workers is 90 seconds Jul 13 08:56:55.651723 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 08:56:55.651804 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: *** Operational MODE: preforking *** Jul 13 08:56:55.652045 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: *** uWSGI is running in multiple interpreter mode *** Jul 13 08:56:55.652045 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: spawned uWSGI master process (pid: 103682) Jul 13 08:56:55.652235 dv-cinder-849626-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 13 08:56:55.656445 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: spawned uWSGI worker 1 (pid: 103683, cores: 1) Jul 13 08:56:55.656445 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: spawned uWSGI worker 2 (pid: 103684, cores: 1) Jul 13 08:56:55.656445 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 08:56:56.314848 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 08:56:56.315445 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 08:56:57.444735 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:56:57.444735 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: from cryptography.utils import int_from_bytes Jul 13 08:56:57.445307 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:56:57.445307 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: from cryptography.utils import int_from_bytes Jul 13 08:56:57.446260 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:56:57.446260 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: from cryptography.utils import int_from_bytes Jul 13 08:56:57.446701 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:56:57.446701 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: from cryptography.utils import int_from_bytes Jul 13 08:56:59.918045 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 08:56:59.918719 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 08:56:59.919080 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 08:56:59.919170 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 08:56:59.919254 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 08:56:59.919254 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 08:56:59.919419 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 08:56:59.919507 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 08:56:59.919599 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 08:56:59.919922 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 08:56:59.920526 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.920750 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.920840 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.921076 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.921161 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.921398 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.921496 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.921722 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.921855 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.922057 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.922888 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.922888 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923073 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923240 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923323 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923400 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923488 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923576 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923654 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923766 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.923857 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.924091 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849626-3-iscsi {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.924184 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849626-3-iscsi {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.924419 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.924509 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.924727 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.924811 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925039 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925126 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925353 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925436 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925657 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925748 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.925976 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.926102 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.926308 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.926392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.926800 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.926907 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.927953 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928046 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928122 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928188 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928251 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928327 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928393 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928457 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928520 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928583 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928771 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.928861 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929059 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929367 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929448 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929686 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929822 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.929994 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.930113 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.930414 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849626-3-iscsi {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.930502 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849626-3-iscsi {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.930728 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.930811 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.931049 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.931155 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.931360 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.931451 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.931769 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.931988 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.932086 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.932212 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.932377 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.932502 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.932695 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.932802 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933015 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933148 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933321 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933404 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933645 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933736 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.933962 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.934085 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.934319 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.934425 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.934636 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.934721 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.934940 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.935078 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.935272 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.935373 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.935580 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.935696 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.935899 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936018 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936205 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936420 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936512 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936730 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936813 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.936981 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.937065 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.937291 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.937382 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.937612 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.937698 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.937932 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938024 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938230 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938314 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938482 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938582 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938749 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.938835 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939067 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939151 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939385 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939469 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939692 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939783 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.939995 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940077 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940299 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940393 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940604 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940688 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940908 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.940989 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.941211 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.941307 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.941514 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.941597 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.941818 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.941909 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.942151 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.942252 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.942464 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.942558 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.942770 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.942852 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.943078 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.943183 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.943393 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.943486 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.943702 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.943786 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944010 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944123 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944322 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944417 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944652 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944735 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.944959 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945053 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945263 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945345 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945580 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945663 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945886 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.945977 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.946215 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.946300 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.946519 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.946605 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.946822 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.946906 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947140 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947224 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947442 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947526 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947693 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947781 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.947993 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948078 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948290 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948382 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948594 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948677 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948897 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.948995 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.949201 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.949299 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.949503 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.949586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.949799 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.949889 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.950117 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.950222 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.950422 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.950507 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.951247 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.951350 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.951554 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.951777 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.951875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.952101 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.952194 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.952414 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.952498 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.952724 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.952815 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953024 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953123 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953330 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953433 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953636 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953726 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.953942 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954026 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954275 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954370 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954580 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954673 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954885 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.954970 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.955190 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.955280 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.955493 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.955583 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.955799 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.955892 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.956108 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.956199 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.956411 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.956495 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.956715 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.956797 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957023 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957114 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957326 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957411 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957628 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957772 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.957936 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958052 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958257 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958340 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958562 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958654 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958860 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.958952 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.959167 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.959260 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.959468 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.959558 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.959769 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.959861 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960070 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960159 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960371 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960461 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960670 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960754 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.960967 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961057 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961269 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961359 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961565 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961649 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961862 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.961943 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.962183 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.962270 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.962503 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.962595 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.962807 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.962900 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.963112 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.963207 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.963417 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.963520 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.963719 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.963804 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.964035 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:56:59.964128 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.964369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.964453 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.964689 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.964770 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965019 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965115 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965334 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965415 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965653 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965752 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.965963 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.966116 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.966357 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.967014 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.967293 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.967503 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.967603 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.967764 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.967897 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.968094 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.968208 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.968411 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.968528 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.968726 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.968849 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.969039 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.969179 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.969361 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.969496 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.969683 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.969812 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970014 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970158 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970353 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970470 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970672 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970787 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.970992 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.971115 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.971304 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.971435 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.971623 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.971751 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.971953 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.972091 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.972273 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.972434 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.972586 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.972865 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.972980 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.973197 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.973395 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.973541 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.973716 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.973822 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.974073 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.974161 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.974384 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.974481 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.974699 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.974789 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975011 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975095 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975329 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975415 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975652 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975736 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.975986 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.976071 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.976297 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.976391 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.976609 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.976701 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.976921 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977012 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977230 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977319 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977538 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977621 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977849 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.977986 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.978184 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.978270 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.978506 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.978588 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.978823 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.978918 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.979136 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.979219 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.979447 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.979531 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.979754 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.979864 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980059 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980148 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980364 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980447 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980667 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980760 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.980971 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.981054 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.981272 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.981361 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.981575 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.981665 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.981910 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.982018 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.982254 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.982418 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.982561 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.982753 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.982888 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.983067 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.983195 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.983382 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.983528 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.983695 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.983837 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984010 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984146 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984318 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984455 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984636 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984766 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.984948 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985076 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985256 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985387 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985581 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985725 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985893 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.985998 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.986228 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.986354 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.986553 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.986635 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.986859 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.986942 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.987165 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.987250 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.987482 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.987565 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.987794 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.987880 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.988107 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.988192 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.988416 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.988497 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.988725 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.988820 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989036 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989120 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989348 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989431 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989657 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989747 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.989969 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.990097 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.990305 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.990396 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.990627 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.990718 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.990952 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991037 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991255 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991338 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991577 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991674 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991884 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.991966 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.992192 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.992277 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.992492 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.992621 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.992792 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.992918 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.993095 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.993178 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.993400 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.993484 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.993699 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.993781 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994000 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994103 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994324 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994422 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994623 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994705 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.994922 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995005 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995231 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995323 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995534 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995626 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995836 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.995928 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.996139 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.996224 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.996440 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.996522 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.996743 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.996835 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.997045 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.997136 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.997385 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.997520 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.997766 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.997986 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.998115 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.998456 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.998600 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.998780 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.998979 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.999104 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.999297 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.999420 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.999616 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.999736 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:56:59.999930 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.000048 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.000245 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.000448 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.000560 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.000767 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.000862 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.001083 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.001168 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.001406 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.001496 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.001720 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.001812 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.002131 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.002237 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.002377 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.002461 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.002704 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.002871 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003002 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003084 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003322 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003411 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003628 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003720 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.003946 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004033 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004280 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004371 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004600 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004686 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004917 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.004998 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.005225 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.005308 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.005538 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.005629 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.005847 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.005930 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.006181 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.006269 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.006493 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.006577 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.006803 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.006887 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.007122 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.007227 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.007433 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.007553 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.007750 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.007866 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.008058 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.008186 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.008378 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.008494 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.008685 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.008819 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009002 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009129 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009306 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009449 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009619 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009754 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.009946 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.010085 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.010302 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.010386 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.010611 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.010705 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.010922 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011015 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011244 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011328 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011554 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011643 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011863 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.011949 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.012181 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.012273 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.012489 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.012574 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.012792 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.012877 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.013627 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.013785 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.013979 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.014140 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.014401 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.014538 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.014716 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.014847 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015029 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015159 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015337 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015480 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015643 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015771 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.015949 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.016086 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.016251 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.016380 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.016552 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.016679 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.016866 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017004 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017174 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017302 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017485 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017613 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017804 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.017939 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.018133 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.018266 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.018440 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.018527 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.018742 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.018834 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019055 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019141 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019360 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019444 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019662 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019754 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.019963 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020054 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020266 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020356 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020601 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020691 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020909 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.020991 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.021215 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.021298 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.021531 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.021616 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.021838 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.021920 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.022176 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.022263 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.022493 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.022586 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.022800 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.022928 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.023115 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.023237 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.023426 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.023527 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.023736 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.023824 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024043 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024151 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024352 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024440 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024661 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024755 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.024972 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025066 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025282 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025368 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025592 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025678 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025905 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.025998 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.026239 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.026328 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.026544 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.026638 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.026847 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.026942 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.027159 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.027245 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.027476 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.027737 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.028037 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.028170 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.028369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.028500 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.028687 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.029360 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.029609 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.029758 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.029999 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.030108 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.030262 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.030449 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.030593 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.030780 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.030921 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.031125 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.031263 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.031426 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.031571 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.031734 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.031881 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032041 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032186 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032348 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032490 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032658 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032800 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.032971 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.033106 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.033281 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.033400 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.033587 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.033694 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.033898 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.034004 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.034227 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.034323 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.034533 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.034633 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.035101 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.035204 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.035406 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.035493 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.035721 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.035809 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036026 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036120 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036337 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036424 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036639 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036726 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.036957 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037042 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037262 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037349 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037561 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037656 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037863 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.037957 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.038187 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.038277 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.038532 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.038679 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.038817 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.038957 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.039156 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.039301 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.039479 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.039605 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.039815 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.039949 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.040119 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.040255 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.040421 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.040558 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.040740 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.040865 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041042 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041178 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041344 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041473 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041645 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041772 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.041952 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042109 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042285 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042370 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042587 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042670 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.042988 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.043204 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.043318 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.043512 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.043606 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.043814 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.043899 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.044114 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.044213 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.044501 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.044833 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.044938 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045060 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045169 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045249 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045374 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045469 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045677 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045768 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.045979 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.046099 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.046311 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.046409 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.046619 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.046709 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.046921 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047006 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047229 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047322 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047531 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047624 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047845 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.047931 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.048145 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.048239 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.048444 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.048534 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.048744 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.048843 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049048 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049133 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049352 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049435 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049652 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049741 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.049969 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050085 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050304 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050398 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050604 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050686 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050904 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.050988 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.051207 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.051290 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.051506 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.051588 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.051808 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.051892 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.052113 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.052194 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.052430 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.052520 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.052741 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.052832 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053041 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053124 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053347 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053493 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053652 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053741 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.053938 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054023 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054262 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054355 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054568 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054662 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054871 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.054955 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.055162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.055254 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.055464 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.055549 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.055764 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.055846 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056064 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056148 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056382 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056464 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056688 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056779 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.056990 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.057076 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.057291 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.057373 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.057589 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.057673 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.057926 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.058010 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.058255 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.058340 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.058613 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.058710 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.058914 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.059055 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.059225 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.059350 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.059540 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.059675 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.059849 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.060011 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.060185 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.060370 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.060504 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.060767 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.060902 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061077 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061206 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061384 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061515 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061695 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061828 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.061997 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.062150 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.062320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.062459 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.062630 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.062758 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.062939 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063065 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063250 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063386 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063559 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063734 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063863 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.063994 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.064185 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.064332 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.064489 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.064637 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.064796 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.064888 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.065103 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.065195 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.065411 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.065494 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.065717 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.065851 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066021 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066206 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066349 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066483 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066648 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066775 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.066958 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.067101 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.067268 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.067392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.067577 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.067703 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.067885 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068013 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068189 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068334 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068495 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068651 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068787 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.068929 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.069087 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.069215 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.069405 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.069530 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.069709 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.069837 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070010 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070160 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070335 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070430 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070637 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070722 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.070939 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.071020 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.071241 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.071360 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.071667 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.071759 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.071977 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072066 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072285 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072378 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072595 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072678 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072905 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.072995 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.073213 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.073304 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.073523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.073609 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.073829 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.073913 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.074154 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.074253 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.074567 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.074650 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.074877 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.074977 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.075190 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.075275 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.075491 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.075574 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.076306 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.076391 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.076617 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.076734 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.076941 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077036 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077246 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077357 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077551 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077664 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077854 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.077969 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.078195 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.078304 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.078502 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.078625 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.078821 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.078930 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.079232 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.079327 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.079542 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.079648 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.079846 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.079971 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.080249 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.080341 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.080557 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.080662 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.080866 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.080973 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.081187 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.081279 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.081506 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.081589 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.081829 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.081919 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.082162 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.082264 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.082476 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.082575 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.082785 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.082869 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.083107 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.083190 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.083426 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.083564 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.083733 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.083818 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084046 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084130 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084349 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084442 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084650 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084734 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.084970 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.085125 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.085271 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.085404 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.085589 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.085720 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.085910 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.086058 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.086331 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.086461 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.086645 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.086774 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.086957 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.087095 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.087279 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.087409 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.087601 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.087728 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.087908 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088045 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088213 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088341 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088522 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088651 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088827 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.088972 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.089142 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.089279 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.089464 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.089556 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.089772 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.089873 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.090105 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.090198 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.090415 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.090502 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.090720 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.090822 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.091022 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.091108 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.091373 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.092034 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.092184 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.092415 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.092521 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.092736 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.092826 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.093054 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.093151 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.093382 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.093469 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.093709 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.093809 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094016 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094132 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094360 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094455 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094671 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094759 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.094976 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.095084 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.095277 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.095364 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.095578 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.095664 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.095920 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096008 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096224 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096309 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096544 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096631 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096872 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.096961 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.097196 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.097282 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.097505 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.097591 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.097834 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.097924 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.098183 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.098274 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.098501 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.098588 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.098815 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.098922 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.099204 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.099305 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.099439 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.099541 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.099738 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.099824 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100043 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100136 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100344 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100439 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100647 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100732 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.100947 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101032 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101251 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101351 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101550 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101636 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101849 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.101934 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.102172 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.102275 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.102495 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.102583 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.102797 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.102882 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.103114 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.103210 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.103420 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.103518 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.103724 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.103874 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104017 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104158 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104315 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104444 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104655 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104782 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.104991 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.105132 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.105263 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.105390 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.105581 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.105719 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.105897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.106025 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.106247 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.106377 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.106556 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.106697 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.106893 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107037 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107214 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107344 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107530 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107671 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107843 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.107979 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.108154 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.108280 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.108468 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.108606 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.108782 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.108910 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.109098 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.109227 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.109406 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.109558 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.109721 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.109856 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.110047 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.110179 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.110368 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.110497 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.110887 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111015 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111213 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111347 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111528 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111664 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111841 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.111977 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.112152 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.112278 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.112487 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.112614 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.112745 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.112883 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113058 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113187 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113367 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113494 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113672 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113822 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.113979 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.114138 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.114330 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.114457 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.114650 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.114779 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.114971 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.115112 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.115305 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.115436 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.115622 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.115762 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.115937 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.116077 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.116248 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.116375 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.116560 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.116698 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.116911 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117054 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117226 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117353 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117528 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117673 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117840 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.117973 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.118174 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.118304 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.118486 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.118622 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.118795 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.118922 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.119104 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.119267 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.119416 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.119509 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.119726 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.119817 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120033 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120117 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120340 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120425 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120649 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120734 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.120960 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.121053 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.121278 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.121363 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.121609 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.121692 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.121928 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.122012 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.122265 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.122353 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.122600 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.122688 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.122914 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.123008 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.123434 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.123521 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.123748 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.123840 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.124079 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.124181 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.124402 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.124488 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.124726 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.124811 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125040 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125133 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125357 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125501 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125678 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125815 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.125985 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126203 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126335 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126470 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126597 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126729 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126909 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.126998 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.127209 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.127293 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.127528 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.127633 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.127836 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.127922 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.128139 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.128223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.128455 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.128540 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.128760 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.128845 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.129289 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.129372 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.129630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.129713 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.129943 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.130063 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.130292 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.130376 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.130628 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.130745 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.130928 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131018 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131232 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131322 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131552 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131646 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131860 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.131945 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.132163 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.132245 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.132477 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.132569 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.132783 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.132867 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133083 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133165 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133385 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133476 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133692 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133775 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.133996 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.134151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.134322 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.134407 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.134627 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.134711 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.134929 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135013 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135253 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135349 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135556 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135639 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135858 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.135940 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.136159 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.136243 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.136466 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.136549 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.136770 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.136854 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137072 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137157 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137374 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137459 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137674 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137765 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.137982 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.138645 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.138833 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.138919 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.139143 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.139238 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.139446 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.139539 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.139756 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.139850 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.140060 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.140154 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.140367 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.140459 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.140712 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.140797 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141034 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141130 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141340 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141424 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141646 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141731 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.141960 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.142068 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.142293 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.142377 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.142610 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.142694 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.142921 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143016 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143231 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143315 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143570 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143662 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143884 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.143971 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.144417 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.144501 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.144752 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.144840 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.145069 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.145155 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.145399 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.145519 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.145730 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.145825 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146072 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146173 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146368 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146453 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146673 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146765 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.146994 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.147078 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.147304 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.147388 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.147612 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.147704 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.147921 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148040 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148232 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148344 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148542 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148629 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148847 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.148930 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.149153 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.149243 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.149457 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.149591 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.149762 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.149853 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.150089 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.150178 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.150402 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.150489 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.150708 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.150791 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151015 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151108 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151326 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151411 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151663 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151747 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.151979 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.152072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.152293 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.152377 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.152791 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.152917 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.152917 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.153118 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.153207 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.153286 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.153510 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.153597 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.154371 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.154526 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.154723 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.154846 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.155050 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.155141 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.155379 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.155467 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.155696 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.155789 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.156003 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.156090 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.156417 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.156511 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.156727 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.156811 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157042 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157126 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157361 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157446 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157671 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157764 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.157990 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.158106 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.158337 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.158423 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.158647 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.158730 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.158965 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.159059 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.159274 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.159357 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.159602 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.159739 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.160203 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.160309 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.160538 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.160659 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.160850 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.160951 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.161155 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.161253 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.161457 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.161555 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.161758 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.161861 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.162083 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.162181 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.162400 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.162498 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.162705 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.162793 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163005 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163093 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163303 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163388 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163607 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163706 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.163907 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164001 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164208 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164312 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164511 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164674 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164806 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.164940 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165086 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165219 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165385 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165527 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165691 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165796 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.165988 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166090 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166311 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166418 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166613 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166709 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166910 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.166998 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.167212 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.167308 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.167511 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.167597 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.167810 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.167896 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.168155 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.168251 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.168409 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.168497 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.168706 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.168798 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.169029 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.169117 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.169356 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.169441 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.169759 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.169915 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170020 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170192 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170339 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170505 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170634 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170826 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.170977 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.171135 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.171271 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.171454 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.171582 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.171786 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.171920 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.172078 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.172213 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.172385 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.172514 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.172715 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.172851 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173024 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173153 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173336 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173464 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173643 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173770 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.173947 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.174090 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.174278 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.174381 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.174586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.174721 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.174909 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175003 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175211 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175305 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175525 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175609 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175845 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.175935 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.176161 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.176253 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.176470 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.176553 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.176781 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.176866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.177090 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.177182 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.177403 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.177487 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.177712 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.177797 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178019 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178139 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178349 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178444 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178658 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178744 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.178967 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179052 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179272 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179362 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179579 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179672 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179894 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.179989 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.180204 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.180287 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.180517 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.180614 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.180840 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.180932 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.181149 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.181233 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.181459 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.181555 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.181781 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.181868 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.182127 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.182215 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.182443 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.182539 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.182773 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.182858 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.183096 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.183181 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.183410 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.183498 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.183723 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.183809 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.184028 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.184112 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.184270 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 08:57:00.184357 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:57:00.184559 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 08:57:00.246402 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO dbcounter [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Registered counter for database nova_api Jul 13 08:57:00.246560 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO dbcounter [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Registered counter for database nova_api Jul 13 08:57:00.360089 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.361583 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_db.sqlalchemy.engines [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.366588 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writer thread running {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.367997 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writer thread running {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.422753 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.context [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85d294e0-0c88-42cf-b9fd-fab8c4554a28(cell1) {{(pid=103684) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 08:57:00.423873 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.context [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85d294e0-0c88-42cf-b9fd-fab8c4554a28(cell1) {{(pid=103683) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 08:57:00.426628 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 08:57:00.427801 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_concurrency.lockutils [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 08:57:00.428211 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 08:57:00.429012 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 08:57:00.429396 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_concurrency.lockutils [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 08:57:00.430228 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_concurrency.lockutils [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 08:57:00.431162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 08:57:00.432352 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_concurrency.lockutils [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 08:57:00.433117 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO dbcounter [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Registered counter for database nova_cell0 Jul 13 08:57:00.434327 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO dbcounter [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Registered counter for database nova_cell0 Jul 13 08:57:00.437444 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO dbcounter [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Registered counter for database nova_cell1 Jul 13 08:57:00.438855 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO dbcounter [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Registered counter for database nova_cell1 Jul 13 08:57:00.444935 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.446546 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.449159 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_db.sqlalchemy.engines [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.450245 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writer thread running {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.451587 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_db.sqlalchemy.engines [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.457638 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writer thread running {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.459701 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writer thread running {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.591098 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writer thread running {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.599999 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO dbcounter [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Registered counter for database nova_cell0 Jul 13 08:57:00.604714 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO dbcounter [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Registered counter for database nova_cell0 Jul 13 08:57:00.608930 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.613309 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writer thread running {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:00.613436 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG oslo_db.sqlalchemy.engines [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:57:00.617657 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writer thread running {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:57:01.025846 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: WARNING keystonemiddleware.auth_token [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 08:57:01.033121 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: WARNING keystonemiddleware.auth_token [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 08:57:01.052530 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: WARNING keystonemiddleware.auth_token [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 08:57:01.059785 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: WARNING keystonemiddleware.auth_token [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 08:57:01.374263 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: WARNING keystonemiddleware.auth_token [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 08:57:01.380239 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: WARNING keystonemiddleware.auth_token [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 08:57:01.385481 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56519277e9c0 pid: 103684 (default app) Jul 13 08:57:01.387567 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:57:01.389458 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002425 Jul 13 08:57:01.389877 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Wed Jul 13 08:57:01 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:57:01.404404 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: WARNING keystonemiddleware.auth_token [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 08:57:01.410632 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: WARNING keystonemiddleware.auth_token [None req-6589f9b3-14fd-411a-8723-b2c9628a4da6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 08:57:01.415856 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56519277e9c0 pid: 103683 (default app) Jul 13 08:58:20.429530 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:20.430689 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jul 13 08:58:20.431100 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:20.449575 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writing DB stats nova_api:SELECT=3 {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:20.450944 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writing DB stats nova_cell0:SELECT=3 {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:20.451849 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writing DB stats nova_cell1:SELECT=3 {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:20.453488 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:21.335515 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-54346a0d-02cd-4608-a06b-fcc9cc52f1a2 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:21.366236 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-54346a0d-02cd-4608-a06b-fcc9cc52f1a2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927659 Jul 13 08:58:21.367967 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 13 08:58:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:23.607742 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:23.608971 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-f8ea2dbc-9a4e-4e36-b182-ae9e64282942 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 13 08:58:23.609549 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:24.073167 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-dd654dda-1293-4a0e-9513-b25f62d3830e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:24.091466 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:58:24.091466 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: warnings.warn(msg) Jul 13 08:58:24.173524 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-dd654dda-1293-4a0e-9513-b25f62d3830e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.557860 Jul 13 08:58:24.174139 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:24.188219 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_api:SELECT=3 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:24.189594 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_cell0:SELECT=3 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:24.190545 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_cell1:SELECT=3 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:24.191407 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:24.397043 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-6d602388-efa3-4bd9-a9ce-a75268f1617b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:24.399491 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:58:24.399491 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: warnings.warn(msg) Jul 13 08:58:24.526991 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-6d602388-efa3-4bd9-a9ce-a75268f1617b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.344629 Jul 13 08:58:24.542065 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 13 08:58:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:26.807723 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-dd654dda-1293-4a0e-9513-b25f62d3830e admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:26.808754 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-dd654dda-1293-4a0e-9513-b25f62d3830e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 13 08:58:26.809587 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:27.487207 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-d35059ba-34aa-4d81-87a2-bfeec1ed40ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "vcpus": 1, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:27.506871 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:58:27.506871 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: warnings.warn(msg) Jul 13 08:58:27.648656 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-d35059ba-34aa-4d81-87a2-bfeec1ed40ce admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.833263 Jul 13 08:58:27.649492 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:27.663388 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-a0c5e767-877a-4467-8ee2-75c2b36cd783 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:27.664913 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:58:27.664913 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: warnings.warn(msg) Jul 13 08:58:27.766472 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-a0c5e767-877a-4467-8ee2-75c2b36cd783 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106869 Jul 13 08:58:27.778062 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 13 08:58:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:30.035664 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-d35059ba-34aa-4d81-87a2-bfeec1ed40ce admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:30.036741 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-d35059ba-34aa-4d81-87a2-bfeec1ed40ce admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 13 08:58:30.037273 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:30.433020 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3e123370-68a3-4dd3-83fc-82df74db0b78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:30.515975 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3e123370-68a3-4dd3-83fc-82df74db0b78 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472362 Jul 13 08:58:30.516726 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:30.529250 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-1a540448-71fb-442e-8d34-d6afefb96960 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:30.622530 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-1a540448-71fb-442e-8d34-d6afefb96960 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097739 Jul 13 08:58:30.623106 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 13 08:58:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:32.897472 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3e123370-68a3-4dd3-83fc-82df74db0b78 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:32.898559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3e123370-68a3-4dd3-83fc-82df74db0b78 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jul 13 08:58:32.899026 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:33.351446 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-0b8881f2-3b3a-4edf-ac25-0e13b2fc6628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:33.441957 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-0b8881f2-3b3a-4edf-ac25-0e13b2fc6628 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536936 Jul 13 08:58:33.442607 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:33.455207 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-701abd30-02cc-4f0c-ace7-c01d71aac8af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:33.530962 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-701abd30-02cc-4f0c-ace7-c01d71aac8af admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079936 Jul 13 08:58:33.531543 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 13 08:58:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:35.773214 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-0b8881f2-3b3a-4edf-ac25-0e13b2fc6628 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:35.774392 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-0b8881f2-3b3a-4edf-ac25-0e13b2fc6628 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 13 08:58:35.774794 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:36.218485 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-5e5bb070-f70d-45fe-916c-7ad57bf48f65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:36.288018 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-5e5bb070-f70d-45fe-916c-7ad57bf48f65 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507343 Jul 13 08:58:36.288862 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 08:58:36.301603 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-f386a9d1-f783-4b37-8e17-8810081a70c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:36.377924 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-f386a9d1-f783-4b37-8e17-8810081a70c1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079991 Jul 13 08:58:36.378811 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 13 08:58:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:38.720594 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-5e5bb070-f70d-45fe-916c-7ad57bf48f65 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:38.721770 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-5e5bb070-f70d-45fe-916c-7ad57bf48f65 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jul 13 08:58:38.722238 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:39.150664 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-a4f46988-3f29-437b-b0a3-33b85175159c admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:39.175417 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-a4f46988-3f29-437b-b0a3-33b85175159c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447227 Jul 13 08:58:39.175987 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 13 08:58:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:58:41.649543 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-5e5bb070-f70d-45fe-916c-7ad57bf48f65 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:41.651905 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-5e5bb070-f70d-45fe-916c-7ad57bf48f65 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Jul 13 08:58:41.651905 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:42.107506 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-aae1a5e3-74e7-4a39-a17d-2dfe63fa04ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:42.203471 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-aae1a5e3-74e7-4a39-a17d-2dfe63fa04ee admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.545904 Jul 13 08:58:42.204032 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:42.217643 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-1c1d2e24-c62e-42c1-b2c3-7b0b175b2b7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:42.301298 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-1c1d2e24-c62e-42c1-b2c3-7b0b175b2b7f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087963 Jul 13 08:58:42.301965 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 13 08:58:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:44.480393 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-aae1a5e3-74e7-4a39-a17d-2dfe63fa04ee admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:44.481445 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-aae1a5e3-74e7-4a39-a17d-2dfe63fa04ee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 13 08:58:44.481847 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:44.875369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-0e514a05-4e23-475c-b71f-ea0120ead276 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:44.961423 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-0e514a05-4e23-475c-b71f-ea0120ead276 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473614 Jul 13 08:58:44.961905 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 08:58:44.974554 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-3d4a48b1-b91e-4a32-8a15-f49d6b21bb3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:45.045668 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-3d4a48b1-b91e-4a32-8a15-f49d6b21bb3a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074769 Jul 13 08:58:45.046288 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 13 08:58:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 08:58:47.298265 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-0e514a05-4e23-475c-b71f-ea0120ead276 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:47.299886 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-0e514a05-4e23-475c-b71f-ea0120ead276 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jul 13 08:58:47.300294 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:47.666541 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-3663b0f8-8888-4429-b67a-73e9b6cdd538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "id": "3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:47.766833 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-3663b0f8-8888-4429-b67a-73e9b6cdd538 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.460698 Jul 13 08:58:47.770084 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:47.780414 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-24f6c869-3d59-4760-8995-6626314063a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:47.869784 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-24f6c869-3d59-4760-8995-6626314063a7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092852 Jul 13 08:58:47.882811 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 13 08:58:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:50.142060 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-3663b0f8-8888-4429-b67a-73e9b6cdd538 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:50.143123 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-3663b0f8-8888-4429-b67a-73e9b6cdd538 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 13 08:58:50.143522 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:50.599151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-aaaad3b5-ea80-4b94-9775-06537a8594ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:50.607067 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:51.286972 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-aaaad3b5-ea80-4b94-9775-06537a8594ab admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.137342 Jul 13 08:58:51.289375 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:51.299137 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-21a48b4f-47b5-42f4-8259-a9df5af4d39a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:51.394170 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-21a48b4f-47b5-42f4-8259-a9df5af4d39a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098560 Jul 13 08:58:51.395072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 13 08:58:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:58:53.653219 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-aaaad3b5-ea80-4b94-9775-06537a8594ab admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:58:53.655051 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-aaaad3b5-ea80-4b94-9775-06537a8594ab admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Jul 13 08:58:53.655521 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:58:54.098050 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-d9888412-d0c0-4020-a983-fd0ff0e7193f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:54.173105 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-d9888412-d0c0-4020-a983-fd0ff0e7193f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.511308 Jul 13 08:58:54.173690 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 13 08:58:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:58:54.185561 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-849f2a30-950e-453f-ac32-e6a06912cc03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:58:54.268305 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-849f2a30-950e-453f-ac32-e6a06912cc03 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085985 Jul 13 08:58:54.282287 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 13 08:58:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 08:59:14.076793 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-d9888412-d0c0-4020-a983-fd0ff0e7193f admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:14.077798 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-d9888412-d0c0-4020-a983-fd0ff0e7193f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 13 08:59:14.078229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 08:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:14.465105 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-2c1ee2bf-b50d-480c-a3dc-1cdb57bf88ed admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:14.482317 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-2c1ee2bf-b50d-480c-a3dc-1cdb57bf88ed admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398396 Jul 13 08:59:14.482849 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 13 08:59:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:59:15.551583 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-d9888412-d0c0-4020-a983-fd0ff0e7193f admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:15.552592 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-d9888412-d0c0-4020-a983-fd0ff0e7193f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 13 08:59:15.552988 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:16.074246 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-04420a1c-794a-4526-b7e8-bb0895053e7a admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:16.079771 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.wsgi [None req-04420a1c-794a-4526-b7e8-bb0895053e7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-04420a1c-794a-4526-b7e8-bb0895053e7a admin admin] Request method failure captured: Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Accept: application/json Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Accept-Encoding: gzip, deflate Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Connection: keep-alive Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Content-Length: 0 Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Host: 10.222.0.40 Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Openstack-Api-Version: compute 2.90 Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Openstack-System-Scope: None Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: User-Agent: python-novaclient Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Auth-Token: gAAAAABizolj7xYUbHCTKgnfWvUuyRG1LzGs-EBKaSGHGqvbsgSh0DV51oRvWhz5ozssa654DlLC0yOEB2902vgFPdp1ltrD51dBoBKUs7NpiL735CJhTVczpjEeISq9LIoHqKYC3UEa5pAMxtsWVSE8c3glNaKstBKq4koLO3xdubRwamcKoZA Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Domain-Id: None Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Domain-Name: None Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Identity-Status: Confirmed Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Is-Admin-Project: True Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Domain-Id: default Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Domain-Name: Default Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Name: admin Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Role: reader,admin,member Jul 13 08:59:16.083012 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Roles: reader,admin,member Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant: admin Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant-Name: admin Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User: admin Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Domain-Id: default Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Domain-Name: Default Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Id: 26ad26ac4aea4a7b8fb923b47a154aa9 Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Name: admin Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: method: > Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: exception: Flavor 42 could not be found. Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: action_args: {'id': '42'} Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 08:59:16.084630 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:16.085559 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.086987 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-04420a1c-794a-4526-b7e8-bb0895053e7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 08:59:16.088405 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-04420a1c-794a-4526-b7e8-bb0895053e7a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392273 Jul 13 08:59:16.088405 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 13 08:59:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:16.094224 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-16e32473-0e97-411c-b54e-bff792f5f2c9 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:16.097165 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:16.116255 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-16e32473-0e97-411c-b54e-bff792f5f2c9 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025540 Jul 13 08:59:16.116787 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 13 08:59:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:59:16.127273 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-794217d2-91a3-45c6-981c-1aca2e1d6d06 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:16.148469 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-794217d2-91a3-45c6-981c-1aca2e1d6d06 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024882 Jul 13 08:59:16.149887 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 13 08:59:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:59:16.159801 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-fb1c0d39-0d7e-4cf5-8f1a-18debaea7f70 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:16.166655 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.wsgi [None req-fb1c0d39-0d7e-4cf5-8f1a-18debaea7f70 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-fb1c0d39-0d7e-4cf5-8f1a-18debaea7f70 admin admin] Request method failure captured: Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Accept: application/json Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Accept-Encoding: gzip, deflate Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Connection: keep-alive Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Content-Length: 0 Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Host: 10.222.0.40 Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Openstack-Api-Version: compute 2.90 Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Openstack-System-Scope: None Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: User-Agent: python-novaclient Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Auth-Token: gAAAAABizolj7xYUbHCTKgnfWvUuyRG1LzGs-EBKaSGHGqvbsgSh0DV51oRvWhz5ozssa654DlLC0yOEB2902vgFPdp1ltrD51dBoBKUs7NpiL735CJhTVczpjEeISq9LIoHqKYC3UEa5pAMxtsWVSE8c3glNaKstBKq4koLO3xdubRwamcKoZA Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Domain-Id: None Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Domain-Name: None Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Identity-Status: Confirmed Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Is-Admin-Project: True Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Domain-Id: default Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Domain-Name: Default Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Name: admin Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Role: reader,admin,member Jul 13 08:59:16.169866 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Roles: reader,admin,member Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant: admin Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant-Name: admin Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User: admin Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Domain-Id: default Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Domain-Name: Default Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Id: 26ad26ac4aea4a7b8fb923b47a154aa9 Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Name: admin Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: method: > Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: exception: Flavor 42 could not be found. Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: action_args: {'id': '42'} Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 08:59:16.172875 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:16.174072 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:16.175229 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-fb1c0d39-0d7e-4cf5-8f1a-18debaea7f70 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 08:59:16.176208 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-fb1c0d39-0d7e-4cf5-8f1a-18debaea7f70 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015680 Jul 13 08:59:16.176208 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 13 08:59:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:17.142556 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-794217d2-91a3-45c6-981c-1aca2e1d6d06 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:17.143770 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-794217d2-91a3-45c6-981c-1aca2e1d6d06 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 13 08:59:17.143945 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:17.718732 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-516d11dd-4406-46cb-a88d-e8e162c88501 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:17.724192 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.wsgi [None req-516d11dd-4406-46cb-a88d-e8e162c88501 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-516d11dd-4406-46cb-a88d-e8e162c88501 admin admin] Request method failure captured: Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Accept: application/json Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Accept-Encoding: gzip, deflate Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Connection: keep-alive Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Content-Length: 0 Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Host: 10.222.0.40 Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Openstack-Api-Version: compute 2.90 Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Openstack-System-Scope: None Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: User-Agent: python-novaclient Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Auth-Token: gAAAAABizollPnSAy3bW3apD4rgzoWkz5dJRN3OSk7f_fBcUas7Zo59o3HMr-jaXXPKt1vXGMWr1vBxdM7M20bxM3-glTT4W2fbLHbzkxhM8dWxg8L1THg6_eDOGsZF6rVFOlW9xbTuiIPjLHlzd0ZmNOfEo5Fi1bpAJ1HF8VWk2_ssn8hFjZKk Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Domain-Id: None Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Domain-Name: None Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Identity-Status: Confirmed Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Is-Admin-Project: True Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Domain-Id: default Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Domain-Name: Default Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Name: admin Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Role: reader,admin,member Jul 13 08:59:17.725749 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Roles: reader,admin,member Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant: admin Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant-Name: admin Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User: admin Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Domain-Id: default Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Domain-Name: Default Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Id: 26ad26ac4aea4a7b8fb923b47a154aa9 Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Name: admin Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: method: > Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: exception: Flavor 84 could not be found. Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: action_args: {'id': '84'} Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 08:59:17.728180 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:17.728992 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.730162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-516d11dd-4406-46cb-a88d-e8e162c88501 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 08:59:17.731365 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-516d11dd-4406-46cb-a88d-e8e162c88501 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.438657 Jul 13 08:59:17.731365 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 13 08:59:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 13 08:59:17.739023 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-be57eff7-666f-4ce0-8926-1f7f74fad863 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:17.753124 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-be57eff7-666f-4ce0-8926-1f7f74fad863 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018347 Jul 13 08:59:17.753680 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 13 08:59:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:59:17.765276 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-205fae9f-6c5f-4d14-a638-12ef69c91ce3 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:17.782662 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-205fae9f-6c5f-4d14-a638-12ef69c91ce3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021454 Jul 13 08:59:17.783388 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 13 08:59:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 08:59:17.794642 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-42c7b2fa-befc-4dc0-8c02-eb92725cced2 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:17.800626 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.wsgi [None req-42c7b2fa-befc-4dc0-8c02-eb92725cced2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-42c7b2fa-befc-4dc0-8c02-eb92725cced2 admin admin] Request method failure captured: Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Accept: application/json Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Accept-Encoding: gzip, deflate Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Connection: keep-alive Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Content-Length: 0 Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Host: 10.222.0.40 Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Openstack-Api-Version: compute 2.90 Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Openstack-System-Scope: None Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: User-Agent: python-novaclient Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Auth-Token: gAAAAABizollPnSAy3bW3apD4rgzoWkz5dJRN3OSk7f_fBcUas7Zo59o3HMr-jaXXPKt1vXGMWr1vBxdM7M20bxM3-glTT4W2fbLHbzkxhM8dWxg8L1THg6_eDOGsZF6rVFOlW9xbTuiIPjLHlzd0ZmNOfEo5Fi1bpAJ1HF8VWk2_ssn8hFjZKk Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Domain-Id: None Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Domain-Name: None Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Identity-Status: Confirmed Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Is-Admin-Project: True Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Domain-Id: default Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Domain-Name: Default Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Name: admin Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Role: reader,admin,member Jul 13 08:59:17.802151 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Roles: reader,admin,member Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant: admin Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant-Name: admin Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User: admin Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Domain-Id: default Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Domain-Name: Default Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Id: 26ad26ac4aea4a7b8fb923b47a154aa9 Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Name: admin Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: method: > Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: exception: Flavor 84 could not be found. Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: action_args: {'id': '84'} Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 08:59:17.803523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:17.804320 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:17.805897 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-42c7b2fa-befc-4dc0-8c02-eb92725cced2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 08:59:17.807005 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-42c7b2fa-befc-4dc0-8c02-eb92725cced2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012502 Jul 13 08:59:17.807005 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 13 08:59:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:18.781280 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-205fae9f-6c5f-4d14-a638-12ef69c91ce3 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:18.782582 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-205fae9f-6c5f-4d14-a638-12ef69c91ce3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Jul 13 08:59:18.782971 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:19.302957 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-81bfa8e0-016b-42a0-9a6c-c305c45a5f8c admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:19.309334 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.wsgi [None req-81bfa8e0-016b-42a0-9a6c-c305c45a5f8c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-81bfa8e0-016b-42a0-9a6c-c305c45a5f8c admin admin] Request method failure captured: Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Accept: application/json Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Accept-Encoding: gzip, deflate Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Connection: keep-alive Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Content-Length: 0 Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Host: 10.222.0.40 Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Openstack-Api-Version: compute 2.90 Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Openstack-System-Scope: None Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: User-Agent: python-novaclient Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Auth-Token: gAAAAABizolmYF-N4Zbme1i0I3_aV-f91wNSO2iiImKBzpi1L9ulx-325YpOTj1jmkVNdtZAZ-VP4LLqhzX8yJY67qCmJL5mVQrva7axZKj69mlzLvJ2AhKWOYcbINJdiZFHeLpZjgXZnFFaOGEibr-5CEj1uGih2HBkiriIGE0C6J4dYwdTegE Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Domain-Id: None Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Domain-Name: None Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Identity-Status: Confirmed Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Is-Admin-Project: True Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Domain-Id: default Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Domain-Name: Default Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Project-Name: admin Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Role: reader,admin,member Jul 13 08:59:19.310875 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Roles: reader,admin,member Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant: admin Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-Tenant-Name: admin Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User: admin Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Domain-Id: default Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Domain-Name: Default Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Id: 26ad26ac4aea4a7b8fb923b47a154aa9 Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: X-User-Name: admin Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: method: > Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: exception: Flavor 451 could not be found. Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: action_args: {'id': '451'} Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 08:59:19.312392 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:19.313210 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.314369 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-81bfa8e0-016b-42a0-9a6c-c305c45a5f8c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 08:59:19.315388 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-81bfa8e0-016b-42a0-9a6c-c305c45a5f8c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391840 Jul 13 08:59:19.315388 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 13 08:59:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:19.322476 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-2f74bd24-ed77-45b4-b859-6ff8ab71ca53 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:19.335900 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-2f74bd24-ed77-45b4-b859-6ff8ab71ca53 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017600 Jul 13 08:59:19.336435 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 13 08:59:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:59:19.346718 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:19.361396 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018171 Jul 13 08:59:19.361916 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 13 08:59:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 08:59:19.371475 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-a98a676a-c516-4bda-9cc8-c009ba73ea68 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:19.376706 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.wsgi [None req-a98a676a-c516-4bda-9cc8-c009ba73ea68 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-a98a676a-c516-4bda-9cc8-c009ba73ea68 admin admin] Request method failure captured: Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Accept: application/json Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Accept-Encoding: gzip, deflate Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Connection: keep-alive Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Content-Length: 0 Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Host: 10.222.0.40 Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Openstack-Api-Version: compute 2.90 Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Openstack-System-Scope: None Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: User-Agent: python-novaclient Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Auth-Token: gAAAAABizolmYF-N4Zbme1i0I3_aV-f91wNSO2iiImKBzpi1L9ulx-325YpOTj1jmkVNdtZAZ-VP4LLqhzX8yJY67qCmJL5mVQrva7axZKj69mlzLvJ2AhKWOYcbINJdiZFHeLpZjgXZnFFaOGEibr-5CEj1uGih2HBkiriIGE0C6J4dYwdTegE Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Domain-Id: None Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Domain-Name: None Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Identity-Status: Confirmed Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Is-Admin-Project: True Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Openstack-Nova-Api-Version: 2.90 Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Domain-Id: default Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Domain-Name: Default Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Project-Name: admin Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Role: reader,admin,member Jul 13 08:59:19.378223 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Roles: reader,admin,member Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8052949c90742f6ada3f8a34d5636f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant: admin Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant-Id: c8052949c90742f6ada3f8a34d5636f8 Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-Tenant-Name: admin Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User: admin Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Domain-Id: default Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Domain-Name: Default Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Id: 26ad26ac4aea4a7b8fb923b47a154aa9 Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: X-User-Name: admin Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: method: > Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: exception: Flavor 451 could not be found. Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: action_args: {'id': '451'} Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 08:59:19.379757 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:19.380598 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: ERROR nova.api.openstack.wsgi Jul 13 08:59:19.381634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-a98a676a-c516-4bda-9cc8-c009ba73ea68 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 08:59:19.382771 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-a98a676a-c516-4bda-9cc8-c009ba73ea68 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012053 Jul 13 08:59:19.382771 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 13 08:59:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:20.335494 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:20.336523 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 13 08:59:20.336991 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:20.861411 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-d2aadfb3-8b02-45f2-8d74-8835f465344d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:59:20.926270 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-d2aadfb3-8b02-45f2-8d74-8835f465344d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.449999 Jul 13 08:59:20.926816 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 13 08:59:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:59:21.889224 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:21.890278 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 13 08:59:21.890692 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:22.408604 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-8a2fa7e9-a997-42ad-8196-2c7b257f3338 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:59:22.480540 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-8a2fa7e9-a997-42ad-8196-2c7b257f3338 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.454455 Jul 13 08:59:22.481117 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 13 08:59:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:59:23.442757 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:23.443788 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 13 08:59:23.444174 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:23.968293 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-eba7102e-65ea-45ea-80f5-eaca7a442122 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:59:24.034692 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-eba7102e-65ea-45ea-80f5-eaca7a442122 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.454496 Jul 13 08:59:24.035423 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 13 08:59:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:59:25.000413 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:25.001418 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 13 08:59:25.001815 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:25.538514 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-8b205e57-f1ef-404c-a0c4-268012bda044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 08:59:25.611206 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-8b205e57-f1ef-404c-a0c4-268012bda044 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470451 Jul 13 08:59:25.611748 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 13 08:59:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 08:59:26.587119 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:26.588124 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 13 08:59:26.588515 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 08:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 08:59:27.108649 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-a66f2df0-8bbc-4d9f-a450-42bb41cb98ff admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 08:59:27.128063 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-a66f2df0-8bbc-4d9f-a450-42bb41cb98ff admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396712 Jul 13 08:59:27.128599 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Jul 13 08:59:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:00:18.781839 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:00:18.782896 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-3c4dbf51-4452-43db-b32b-f316f346aeee admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 13 09:00:18.783293 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 13 09:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:00:18.793978 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:19.190000 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-73a6efbf-7baa-4578-b01f-c3d90f5423fe admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:00:19.209628 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-73a6efbf-7baa-4578-b01f-c3d90f5423fe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420049 Jul 13 09:00:19.210115 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 13 09:00:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:00:19.232796 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-7ac36b4b-3ab7-43cd-bb25-795bdd012153 admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:00:19.236234 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG dbcounter [-] [103683] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:19.241113 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-7ac36b4b-3ab7-43cd-bb25-795bdd012153 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011920 Jul 13 09:00:19.242363 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Wed Jul 13 09:00:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:00:19.253649 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-f3168497-8a9d-4a1b-a49a-8c77d5105fd5 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:00:19.261831 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-f3168497-8a9d-4a1b-a49a-8c77d5105fd5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011712 Jul 13 09:00:19.262388 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Wed Jul 13 09:00:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:00:19.273852 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:00:19.282020 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011818 Jul 13 09:00:19.282562 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Wed Jul 13 09:00:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:00:19.293610 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-b54bfb85-a5d9-4fdf-8c2f-5e0fc60b8bc5 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:00:19.301218 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-b54bfb85-a5d9-4fdf-8c2f-5e0fc60b8bc5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011027 Jul 13 09:00:19.301743 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Wed Jul 13 09:00:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:04:03.626417 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:03.628087 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Jul 13 09:04:03.628513 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 09:04:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:04:03.769803 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_api:SELECT=6 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:03.911711 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-0a578ce7-b0f0-4bd4-bba5-8ed63fccb1f8 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:03.912910 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:04:03.912910 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: warnings.warn(msg) Jul 13 09:04:03.914162 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-0a578ce7-b0f0-4bd4-bba5-8ed63fccb1f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:03.914602 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-0a578ce7-b0f0-4bd4-bba5-8ed63fccb1f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:03.915384 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-0a578ce7-b0f0-4bd4-bba5-8ed63fccb1f8 admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:03.915848 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-0a578ce7-b0f0-4bd4-bba5-8ed63fccb1f8 admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:03.949463 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-0a578ce7-b0f0-4bd4-bba5-8ed63fccb1f8 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.181842 Jul 13 09:04:03.950016 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 13 09:04:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:04:04.781004 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:04.782112 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 13 09:04:04.782581 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 09:04:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:04:04.971513 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-4f375b10-4ec9-476f-a774-dd7ff4dba097 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:04.972688 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:04:04.972688 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: warnings.warn(msg) Jul 13 09:04:04.973873 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-4f375b10-4ec9-476f-a774-dd7ff4dba097 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:04.974367 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-4f375b10-4ec9-476f-a774-dd7ff4dba097 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:04.975187 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-4f375b10-4ec9-476f-a774-dd7ff4dba097 admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:04.975618 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-4f375b10-4ec9-476f-a774-dd7ff4dba097 admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:04.996416 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-4f375b10-4ec9-476f-a774-dd7ff4dba097 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076138 Jul 13 09:04:04.996966 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 13 09:04:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:04:16.250372 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:16.251377 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 13 09:04:16.251767 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 09:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:04:16.393977 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_cell0:SELECT=4 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:16.395400 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_cell1:SELECT=4 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:16.396015 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG dbcounter [-] [103684] Writing DB stats nova_api:SELECT=8 {{(pid=103684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:16.443859 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-97c9b970-9c72-4a8e-93b2-2b2250b49594 admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:16.447586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:04:16.447586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: warnings.warn(msg) Jul 13 09:04:16.447586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-97c9b970-9c72-4a8e-93b2-2b2250b49594 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:16.447586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-97c9b970-9c72-4a8e-93b2-2b2250b49594 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:16.447586 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-97c9b970-9c72-4a8e-93b2-2b2250b49594 admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:16.448011 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-97c9b970-9c72-4a8e-93b2-2b2250b49594 admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:16.474288 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-97c9b970-9c72-4a8e-93b2-2b2250b49594 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084592 Jul 13 09:04:16.474846 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 13 09:04:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:04:17.416190 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: DEBUG nova.api.openstack.wsgi [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] Calling method '>' {{(pid=103683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:17.417202 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: INFO nova.api.openstack.requestlog [None req-7239eb26-706a-4121-bea8-ecf121b1ad0a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jul 13 09:04:17.417598 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: [pid: 103683|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 13 09:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:04:17.606480 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG nova.api.openstack.wsgi [None req-87386232-5db9-49dd-90aa-cc5a8cfea3df admin admin] Calling method '>' {{(pid=103684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:04:17.607639 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:04:17.607639 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: warnings.warn(msg) Jul 13 09:04:17.608960 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-87386232-5db9-49dd-90aa-cc5a8cfea3df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:17.609396 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-87386232-5db9-49dd-90aa-cc5a8cfea3df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:17.610209 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-87386232-5db9-49dd-90aa-cc5a8cfea3df admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:04:17.610634 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: DEBUG oslo_concurrency.lockutils [None req-87386232-5db9-49dd-90aa-cc5a8cfea3df admin admin] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:04:17.631754 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: INFO nova.api.openstack.requestlog [None req-87386232-5db9-49dd-90aa-cc5a8cfea3df admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076843 Jul 13 09:04:17.632293 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: [pid: 103684|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 13 09:04:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:05:12.242834 dv-cinder-849626-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 13 09:05:12.243363 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: Wed Jul 13 09:05:12 2022 - graceful shutdown triggered... Jul 13 09:05:12.243816 dv-cinder-849626-3-iscsi devstack@n-api.service[103684]: Gracefully killing worker 2 (pid: 103684)... Jul 13 09:05:12.244180 dv-cinder-849626-3-iscsi devstack@n-api.service[103683]: Gracefully killing worker 1 (pid: 103683)... Jul 13 09:05:13.244327 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: worker 1 buried after 1 seconds Jul 13 09:05:13.244895 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: worker 2 buried after 1 seconds Jul 13 09:05:13.244895 dv-cinder-849626-3-iscsi devstack@n-api.service[103682]: goodbye to uWSGI. Jul 13 09:05:13.245906 dv-cinder-849626-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 13 09:05:13.246475 dv-cinder-849626-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 13 09:05:13.249321 dv-cinder-849626-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 13 09:05:13.258890 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 09:05:13 2022] *** Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: nodename: dv-cinder-849626-3-iscsi Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: machine: x86_64 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: clock source: unix Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: pcre jit disabled Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: detected number of CPU cores: 4 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: current working directory: / Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: detected binary path: /usr/bin/uwsgi-core Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: your processes number limit is 47680 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: your memory page size is 4096 bytes Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: detected max file descriptor number: 2048 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: lock engine: pthread robust mutexes Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: thunder lock: enabled Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 13 09:05:13.261309 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 09:05:13.307500 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: Python main interpreter initialized at 0x5594994c89c0 Jul 13 09:05:13.307500 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: python threads support enabled Jul 13 09:05:13.307500 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: your server socket listen backlog is limited to 100 connections Jul 13 09:05:13.307500 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: your mercy for graceful operations on workers is 90 seconds Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: *** Operational MODE: preforking *** Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: *** uWSGI is running in multiple interpreter mode *** Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: spawned uWSGI master process (pid: 118237) Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: spawned uWSGI worker 1 (pid: 118252, cores: 1) Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: spawned uWSGI worker 2 (pid: 118253, cores: 1) Jul 13 09:05:13.317445 dv-cinder-849626-3-iscsi devstack@n-api.service[118237]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 09:05:13.308450 dv-cinder-849626-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 13 09:05:13.970397 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 09:05:13.981617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 13 09:05:15.172159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:05:15.172159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: from cryptography.utils import int_from_bytes Jul 13 09:05:15.172808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:05:15.172808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: from cryptography.utils import int_from_bytes Jul 13 09:05:15.208710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:05:15.208710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: from cryptography.utils import int_from_bytes Jul 13 09:05:15.209732 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:05:15.209732 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: from cryptography.utils import int_from_bytes Jul 13 09:05:17.481853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 09:05:17.482433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 09:05:17.482731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 09:05:17.482958 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 09:05:17.483215 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 09:05:17.483606 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.483937 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.484263 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.484588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.484921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.485236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.485562 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.485884 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.486240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.486505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.486826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.487153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849626-3-iscsi {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.487480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.487788 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.488102 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.488422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.488723 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.489052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.489362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.489866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.491537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.491537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.491537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.491537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.491870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.491950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.492220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.492540 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.492853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.493168 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.494404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849626-3-iscsi {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.494404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.494404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.495052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.495052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.495471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.495943 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.495943 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.496379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.496602 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.496823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.497126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.497447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.497757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.498083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.498408 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.498721 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.499053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.499370 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.499670 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.499922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.500234 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.500559 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.500885 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.501212 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.501469 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.501725 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.502064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.502395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.502709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.503028 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.503338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.503650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.503961 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.504277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.504587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.504899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.505384 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.505549 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.505840 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.506211 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.506540 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.507117 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.507375 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.507690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.508049 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.508352 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.508754 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.509082 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.509405 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.509718 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.510058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.510366 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.510690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.511034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.511345 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.511599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.511906 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.512219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.512542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.512853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.513167 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.513475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.513780 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.514112 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.514432 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.514744 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.515056 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.515368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.515679 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.515993 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.516304 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.516614 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.516937 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.517262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.517575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.517887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.518233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.518548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.518875 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.519187 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.519498 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.519823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.520389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.520698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.521020 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.521334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.522428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.522943 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.523261 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.523583 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.523906 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.524222 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.524536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.524846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.525163 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.525473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.525782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.526143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.526431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.526740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.527063 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.527389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.527708 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.528020 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.528331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.528656 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.529000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.529339 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.529740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.530135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.530479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.531090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.534076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.535447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.535447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.535447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.535447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.535447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.536350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.536350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.536350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.536828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.536828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.537100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.538182 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.538512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.538852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.539187 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.539510 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.539832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.540152 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.540481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.540829 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.541153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.541481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.541802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.542148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.542472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.542793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.543111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.543456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.543777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.544100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.544420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.544744 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.545069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.545388 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.545708 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.546019 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.546352 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.546667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.546983 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.547295 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.547623 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.547955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.548268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.548606 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.548921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.549239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.549555 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.549873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.550213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.550532 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.550849 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.551162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.551319 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 09:05:17.551733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.551832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 09:05:17.551918 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.552095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.552188 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 09:05:17.552424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.552523 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 09:05:17.552698 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 09:05:17.552817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.553126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.553353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.553454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.553757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.553851 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.554095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.554191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.554418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.554508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.554736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.554837 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.555072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.555164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.555391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.555489 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.555710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.555810 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.556050 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.556142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.556317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.556456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.556632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.556741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.556961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849626-3-iscsi {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.557064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.557286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.557394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.557595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.557687 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.557907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.558000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.558248 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.558359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.558561 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.558671 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.558869 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.558976 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.559178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.559308 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.559493 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.559680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.559791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.559992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.560098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.560299 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.560393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.560611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.560710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.560947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.561054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.561264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.561365 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.561579 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.561713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.561893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.562001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.562223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.562315 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.562532 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.562623 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.562848 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.562948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.563179 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.563269 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849626-3-iscsi {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.563524 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.563624 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.563843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.563940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.564157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.564260 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.564487 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.564587 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.564804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.564902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.565130 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.565229 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.565447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.565603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.565766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.565866 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.566090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.566219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.566424 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.566520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.566745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.566844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.567061 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.567160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.567379 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.567471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.567683 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.567776 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.567993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.568084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.568303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.568452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.568661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.568758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.568973 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.569314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.569478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.569643 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.569833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.569936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.570197 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.570336 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.570525 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.570638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.570854 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.570955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.571173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.571268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.571427 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.571526 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.571682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.571815 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.572006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.572101 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.572329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.572424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.572642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.572732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.572955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.573060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.573264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.573363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.573574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.573666 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.573885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.573994 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.574221 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.574315 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.574533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.574624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.574846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.574948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.575166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.575258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.575483 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.575582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.575805 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.575951 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.576118 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.576252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.576441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.576582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.576756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.576860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.577081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.577172 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.577389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.577481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.577701 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.577792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.578018 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.578191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.578350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.578451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.578662 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.578754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.578976 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.579067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.579284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.579389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.579595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.579694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.579904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.580006 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.580211 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.580301 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.580529 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.580633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.580839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.580944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.581089 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.581233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.581393 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.581485 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.581701 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.581821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.582104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.582226 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.582348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.582449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.582660 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.582750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.582969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.583070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.583273 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.583365 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.583582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.583688 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.583895 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.584585 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.584740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.584840 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.585202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.585342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.585521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.585640 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.585831 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.585924 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.586205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.586313 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.586523 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.586616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.586832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.586930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.587153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.587245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.587483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.587583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.587794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.587896 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.588108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.588207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.588419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.588515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.588732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.588836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.589061 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.589151 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.589369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.589459 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.589680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.589845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.589996 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.590174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.590331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.590437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.590643 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.590739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.590957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.591055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.591265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.591356 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.591577 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.591670 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.591891 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.591982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.592197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.592305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.592506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.592606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.592819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.592925 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.593129 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.593236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.593437 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.593703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.593802 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.594060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.594170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.594364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.594477 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.594672 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.594770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.594979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.595091 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.595288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.595440 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.595591 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.595695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.595911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.596005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.596234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.596333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.596547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.596656 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.596856 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.596956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.597166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.597265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.597475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.597574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:05:17.597793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.597884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.598136 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.598244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.598451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.598552 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.598761 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.598861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.599077 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.599169 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.599387 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.599491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.600311 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.600461 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.600631 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.600918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601380 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601568 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601669 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.601990 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.602225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.602335 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.602549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.602661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.602860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.602964 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.603170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.603271 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.603480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.603571 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.603790 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.603895 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.604132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.604223 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.604439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.604529 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.604759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.604870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.605084 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.605179 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.605419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.605562 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.605735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.605827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.606064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.606158 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.606393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.606491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.606703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.606796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607013 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607635 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.607950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608041 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608257 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608569 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608881 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.608977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.609198 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.609298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.609512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.609612 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.609822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.609921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.610157 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.610264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.610468 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.610597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.610784 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.610877 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.611095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.611193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.611405 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.611539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.611713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.611806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612429 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612649 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612767 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.612963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613068 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613271 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.613986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.614221 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.614329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.614529 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.614626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.614838 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.614936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.615149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.615255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.615480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.615602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.615809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.616058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.616161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.616399 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.616501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.616712 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.616803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617023 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617330 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617421 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617729 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.617948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.618074 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.618298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.618397 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.618610 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.618708 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.618916 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619008 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619230 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.619936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.620152 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.620256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.620459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.620595 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.620763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.620897 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621466 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.621988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.622121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.622328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.622438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.622639 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.622744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.622950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623063 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623254 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623346 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623661 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623877 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.623968 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.624200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.624293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.624532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.624623 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.624844 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.624944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.625169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.625277 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.625493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.625685 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.625798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.625884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.626126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.626235 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.626449 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.626561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.626754 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.626846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627158 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627681 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627773 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.627988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.628077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.628295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.628409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.628606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.628701 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.628910 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629348 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629547 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629640 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.629949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.630203 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.630299 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.630512 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.630618 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.630820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.631491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.631861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.631971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.632189 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.632301 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.632505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.632641 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.632824 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.632995 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.633128 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.633314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.633447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.633644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.633768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.633964 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.634178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.634315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.634420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.634633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.634735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.634953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.635052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.635270 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.635363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.635587 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.635680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.635912 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636228 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636636 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.636952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.637164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.637270 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.637477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.637568 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.637785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.637876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.638123 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.638259 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.638446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.638579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.638789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.638890 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.639124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.639266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.639443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.639536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.639772 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.639865 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.640087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.640193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.640405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.640499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.640712 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.640847 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641024 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.641989 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.642106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.642293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.642397 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.642615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.642709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.642929 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.643967 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.644184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.644276 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.644497 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.644594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.644808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.644906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.645385 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.645491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.645706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.645807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.646024 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.646159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.646375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.646482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.647304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.647411 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.647692 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.647855 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648180 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648488 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648788 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.648956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.649121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.649256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.649444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.649612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.649768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.649861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.650106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.650216 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.650420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.650521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.650740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.650840 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651052 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651457 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651800 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.651978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.652087 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.652303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.652396 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.652617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.652710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.652939 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.653088 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.653263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.653406 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.653570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.653719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.653875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.654066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.654226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.654395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.654541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.654706 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.654849 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655016 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655640 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.655950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.656109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.656283 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.656416 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.656592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.656735 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.656909 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.657059 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.657225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.657372 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.657540 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.657690 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.657848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658004 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658194 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658339 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658667 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.658985 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.659157 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.659298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.659476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.659618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.659801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.659935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.660126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.660249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.660437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.660564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.660769 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.660889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.661084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.661222 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.661395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.661496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.661702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.661831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.662011 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.662205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.662419 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.662737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.662883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.663060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.663153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.663395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.663649 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.663745 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.663988 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.664095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.664311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.664417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.664635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.664733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.664959 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.665050 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.665283 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.665376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.665609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.665698 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.665920 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666886 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.666979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.667193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.667273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.667501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.667617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.667810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.667903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.668116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.668216 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.668417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.668521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.668723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.668821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.669038 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.669138 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.669350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.669471 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.669660 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.669790 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.670443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.670443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.670642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.670897 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.671245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.671404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.671549 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.671749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.672073 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.672198 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.672499 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.672683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.672790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673396 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673666 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.673944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.674081 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.674283 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.674385 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.674595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.674689 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.674913 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675234 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675875 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.675968 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.676196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.676289 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.676526 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.676663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.676803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.676892 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.677131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.677234 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.677442 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.677533 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.677770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.678008 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.678309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.678414 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.678679 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.678777 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.678998 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.679098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.679311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.679402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.679627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.679725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.679944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680047 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680879 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.680986 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.681191 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.681285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.681498 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.681588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.681817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.681910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.682157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.682307 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.682469 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.682561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.682777 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.682870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.683091 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.683185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.683405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.683496 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.683719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.683833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684036 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684343 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.684972 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.685078 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.685280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.685360 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.685589 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.685689 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.685902 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686344 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686545 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686646 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686862 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.686995 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.687173 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.687264 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.687480 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.687573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.687787 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.687893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.688100 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.688193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.688406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.688506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.688714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.688807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689117 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689664 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.689971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.690082 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.690318 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.690527 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.690632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.690848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.690948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.691187 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.691287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.691508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.691599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.691812 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.691904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.692116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.692253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.692421 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.692521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.692726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.692825 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.693031 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.693122 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.693355 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.694018 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.694329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.694429 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.694655 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.694893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.695006 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.695216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.695316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.695534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.695635 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.695875 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.696044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.696191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.696287 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.696504 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.696602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.696861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.697048 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.697166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.697403 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.697506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.697725 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.697839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.698074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.698182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.698409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.698514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.698728 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.698834 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699039 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699128 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699355 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699767 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.699975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.700066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.700291 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.700382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.700608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.700718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.700922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701021 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701235 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701653 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.701961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.702202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.702293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.702521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.702622 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.702831 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.702931 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.703146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.703236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.703462 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.703560 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.703772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.703864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.704080 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.704182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.704395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.704497 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.704702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.704793 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705011 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705111 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705411 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705732 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.705939 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706270 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.706991 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.707205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.707297 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.707513 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.707613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.707821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.707912 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.708137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.708235 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.708448 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.708546 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.708765 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.708864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.709614 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.709728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.709970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.710316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.710436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.710642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.710736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.710964 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.711056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.711280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.711382 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.711600 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.711699 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.711921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.712014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.712245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.712464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.712557 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.712805 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.712901 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.713131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.713276 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.713468 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.713595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.713804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.713896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.714140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.714293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.714454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.714546 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.714764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.714864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.715095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.715203 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.715411 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.715503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.715726 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.715825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716040 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.716971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.717070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.717283 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.717375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.717597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.717688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.717908 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.718008 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.718245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.718349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.718559 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.718726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.718872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.719040 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.719183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.719354 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.719501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.719679 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.719844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720335 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720489 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720643 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.720958 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.721134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.721271 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.721449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.721598 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.721763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.721926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.722095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.722267 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.722410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.722585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.722731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.722894 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.723071 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.723220 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.723389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.723546 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.723698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.723864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.724118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.724211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.724434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.724592 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.725167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.725339 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.725572 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.725729 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.725897 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.726254 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.726360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.726589 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.726911 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.727080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.727240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.727443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.727547 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.727766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.727868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.728085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.728215 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.728399 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.728551 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.728715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.728885 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729043 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729356 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729511 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.729991 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.730229 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.730323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.730556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.730647 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.730872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.730972 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.731181 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.731282 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.731495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.731595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.731811 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.731950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.732122 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.732216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.732429 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.732520 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.732738 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.732831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733048 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733150 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.733977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.734127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.734314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.734421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.734621 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.734745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.734929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735551 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735652 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.735953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.736167 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.736304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.736476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.736602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.736785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.736912 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.737092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.737216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.737430 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.737557 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.737760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.737852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.738097 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.738205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.738408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.738501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.738715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.738808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.739027 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.739128 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.739335 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.739443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.739646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.739778 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742064 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742572 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742662 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742756 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742850 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.742934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743025 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.743907 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.744149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.744251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.744472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.744574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.744800 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.744901 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.745123 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.745223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.745444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.745591 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.745779 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.745918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.746111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.746245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.746426 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.746570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.746743 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.746880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747672 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.747986 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.748160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.748448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.748589 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.748739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.748888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749209 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749490 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749647 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.749946 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750123 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750223 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.750953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.751185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.751285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.751518 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.751610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.751854 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.752069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.752291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.752408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.752510 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.752730 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.752833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.753007 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 09:05:17.753105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.753354 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.753674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.753994 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.754338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.754655 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.754971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.755288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.755621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.756473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.756981 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.757515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.757854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.758206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.758537 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.758864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.759239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.759566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.759885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.760206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.760536 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.760860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.761178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.761498 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.761832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.762164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.762491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.762806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.763127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.763446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.763783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.764130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.764462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.764784 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.765120 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.765426 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.766013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.766373 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.766718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.767051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.767382 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.767708 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.768105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.768367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.768678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.768989 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.769307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.769622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.769933 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.770558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.770874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.771185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.771512 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.772595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.773539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.773903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.774261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.774600 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.774935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.775263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.775578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.775909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.776225 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.776535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.776857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.777179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.777492 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.777800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.778143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.778464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.778773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.779087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.779398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.779733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.780044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.780351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.780667 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.780982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.781291 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.781599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.781907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.782242 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.782559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.782868 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.783293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.783481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.783796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.784103 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.784414 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.784769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.785106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.785417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.785724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.786077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.786388 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.786712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.787029 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.787883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.788451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.788981 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.789585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.789927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.790293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.790647 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.790986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.791301 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.791610 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.791920 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.792249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.792564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.792885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.793199 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.793520 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.793835 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.794180 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.794496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.794811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.795124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.795436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.795747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.796060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.796371 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.796694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.797052 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.797379 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.797702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.798022 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.798379 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.798696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.799010 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.799326 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.799638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.799958 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.800292 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.800617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.800926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.801366 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.801686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.802012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.802362 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.802676 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.803707 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.804317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.804688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.805022 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.805342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.805680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.806066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.806395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.806729 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.807046 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.807359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.807671 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.807986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.808310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.808625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.808935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.809240 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.809552 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.809860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.810193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.810500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.810817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.811129 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.811435 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.811741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.812049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.812354 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.812661 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.812969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.813281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.813599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.813966 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.814272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.814510 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.814815 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.815160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.815498 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.815817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.816143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.816462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.816789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.817104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.817430 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.817757 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.818103 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.818450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.818838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.819409 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.819804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.820127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.820446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.820843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.821167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.821509 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.821841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.822181 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.822519 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.822843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.823171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.823496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.823808 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.824143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.824459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.824772 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.825085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.825400 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.825716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.826057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.826371 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.826686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.827007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.827326 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.827659 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.827990 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.828303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.828634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.828962 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.829324 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.829637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.829987 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.830344 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.830667 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.830984 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.831294 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:05:17.831539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 09:05:17.906520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO dbcounter [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Registered counter for database nova_api Jul 13 09:05:17.930420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:17.937097 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writer thread running {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:17.985313 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO dbcounter [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Registered counter for database nova_api Jul 13 09:05:17.993145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.context [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85d294e0-0c88-42cf-b9fd-fab8c4554a28(cell1) {{(pid=118253) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 09:05:17.997199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:05:17.998826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:05:17.999627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:05:18.001724 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:05:18.003663 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO dbcounter [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Registered counter for database nova_cell0 Jul 13 09:05:18.006902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_db.sqlalchemy.engines [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.008179 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO dbcounter [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Registered counter for database nova_cell1 Jul 13 09:05:18.013840 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writer thread running {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.015701 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.017384 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.023610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writer thread running {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.026059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writer thread running {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.071933 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.context [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85d294e0-0c88-42cf-b9fd-fab8c4554a28(cell1) {{(pid=118252) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 09:05:18.076048 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:05:18.077654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:05:18.078528 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:05:18.080513 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:05:18.082557 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO dbcounter [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Registered counter for database nova_cell0 Jul 13 09:05:18.087469 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO dbcounter [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Registered counter for database nova_cell1 Jul 13 09:05:18.094740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_db.sqlalchemy.engines [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.097212 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_db.sqlalchemy.engines [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.105921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writer thread running {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.106290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writer thread running {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.171678 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO dbcounter [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Registered counter for database nova_cell0 Jul 13 09:05:18.180085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.184586 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writer thread running {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.252535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO dbcounter [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Registered counter for database nova_cell0 Jul 13 09:05:18.259954 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_db.sqlalchemy.engines [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:05:18.265085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writer thread running {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:05:18.503110 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: WARNING keystonemiddleware.auth_token [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 09:05:18.510372 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: WARNING keystonemiddleware.auth_token [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 09:05:18.598073 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: WARNING keystonemiddleware.auth_token [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 09:05:18.606104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: WARNING keystonemiddleware.auth_token [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 09:05:18.847530 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: WARNING keystonemiddleware.auth_token [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 09:05:18.854316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: WARNING keystonemiddleware.auth_token [None req-a7ea3caf-fcbb-454b-85aa-740685e8d23b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 09:05:18.860680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594994c89c0 pid: 118253 (default app) Jul 13 09:05:18.948889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: WARNING keystonemiddleware.auth_token [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 09:05:18.954902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: WARNING keystonemiddleware.auth_token [None req-c0200f28-688e-49a1-a7e5-81aebe65a456 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 09:05:18.961458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594994c89c0 pid: 118252 (default app) Jul 13 09:06:00.033022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:00.035194 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:00.036326 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:00.037044 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:01.008764 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:01.009322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:01.010109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:01.011082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:01.715174 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9a37a635-0d91-455b-91c3-cea2a9218b79 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Action: 'create', calling method: .version_select at 0x7fad238bac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2085878586"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:02.701284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5361b14f-0950-4810-8f50-e0b6a2f51cb7 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Action: 'create', calling method: .version_select at 0x7fad238bac10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-629978861", "metadata": {"Type": "work"}}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5361b14f-0950-4810-8f50-e0b6a2f51cb7 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Request method failure captured: Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 121 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor4TUrBVRZEK47xVwBdfXvv43V-Q2dt2MC-GeYG0AHhuhC6NDbx5MI45SuJOWv8rDrmMAUdGldbT4k-qbednyQGUcEicOLRys7y9dH8dA_Ha7XkaZK3n9CbrtqqgJGCsAjaAWD4qAHcQyd77nIKzKLbQUdkQ132ap4-DXcENhNkap4 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:02.738727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b9915e7547ac42f89570543def2962b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b9915e7547ac42f89570543def2962b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3dcc00db9ed943beb658c7d09e66f9be Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-629978861", "metadata": {"Type": "work"}}} Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:02.740110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-629978861', 'metadata': {'Type': 'work'}}}} Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise error Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi '#$%' Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:02.740903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 13 09:06:02.742329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 13 09:06:02.743493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 13 09:06:02.743493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.743493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5361b14f-0950-4810-8f50-e0b6a2f51cb7 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:02.743493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5361b14f-0950-4810-8f50-e0b6a2f51cb7 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.737279 Jul 13 09:06:02.743493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Jul 13 09:06:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1740 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-46873f2b-d5fd-477d-94a7-7ab004adb5d3 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Action: 'create', calling method: .version_select at 0x7fad238daee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-683840990", "metadata": {"Type": "work"}}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-46873f2b-d5fd-477d-94a7-7ab004adb5d3 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Request method failure captured: Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 119 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor4TUrBVRZEK47xVwBdfXvv43V-Q2dt2MC-GeYG0AHhuhC6NDbx5MI45SuJOWv8rDrmMAUdGldbT4k-qbednyQGUcEicOLRys7y9dH8dA_Ha7XkaZK3n9CbrtqqgJGCsAjaAWD4qAHcQyd77nIKzKLbQUdkQ132ap4-DXcENhNkap4 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:02.761896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b9915e7547ac42f89570543def2962b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b9915e7547ac42f89570543def2962b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3dcc00db9ed943beb658c7d09e66f9be Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-683840990", "metadata": {"Type": "work"}}} Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:02.763553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-683840990', 'metadata': {'Type': 'work'}}}} Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise error Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi '0' Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:02.764311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 13 09:06:02.767559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 13 09:06:02.776800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 13 09:06:02.776800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.776800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-46873f2b-d5fd-477d-94a7-7ab004adb5d3 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:02.776800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-46873f2b-d5fd-477d-94a7-7ab004adb5d3 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008795 Jul 13 09:06:02.776800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 2/2] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Jul 13 09:06:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:06:02.782621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4f501cb1-cd13-45fb-ba01-a739f9e46997 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Action: 'create', calling method: .version_select at 0x7fad238da0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-30315365", "metadata": {"Type": "work"}}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4f501cb1-cd13-45fb-ba01-a739f9e46997 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Request method failure captured: Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 117 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor4TUrBVRZEK47xVwBdfXvv43V-Q2dt2MC-GeYG0AHhuhC6NDbx5MI45SuJOWv8rDrmMAUdGldbT4k-qbednyQGUcEicOLRys7y9dH8dA_Ha7XkaZK3n9CbrtqqgJGCsAjaAWD4qAHcQyd77nIKzKLbQUdkQ132ap4-DXcENhNkap4 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:02.786389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b9915e7547ac42f89570543def2962b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b9915e7547ac42f89570543def2962b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3dcc00db9ed943beb658c7d09e66f9be Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-30315365", "metadata": {"Type": "work"}}} Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:02.788055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-30315365', 'metadata': {'Type': 'work'}}}} Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise error Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi '' Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:02.789001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 13 09:06:02.790745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 13 09:06:02.802446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 13 09:06:02.802446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:02.802446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4f501cb1-cd13-45fb-ba01-a739f9e46997 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:02.802446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4f501cb1-cd13-45fb-ba01-a739f9e46997 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013728 Jul 13 09:06:02.802446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Jul 13 09:06:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:06:02.806395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-73e2dfc8-7a6b-4670-ac51-232544a49e41 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Calling method '.version_select at 0x7fad237eac10>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-73e2dfc8-7a6b-4670-ac51-232544a49e41 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] HTTP exception thrown: Volume tempest-invalid-1833633245 could not be found. Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-73e2dfc8-7a6b-4670-ac51-232544a49e41 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Request method failure captured: Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1833633245 HTTP/1.1 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor4TUrBVRZEK47xVwBdfXvv43V-Q2dt2MC-GeYG0AHhuhC6NDbx5MI45SuJOWv8rDrmMAUdGldbT4k-qbednyQGUcEicOLRys7y9dH8dA_Ha7XkaZK3n9CbrtqqgJGCsAjaAWD4qAHcQyd77nIKzKLbQUdkQ132ap4-DXcENhNkap4 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:03.505374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b9915e7547ac42f89570543def2962b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b9915e7547ac42f89570543def2962b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3dcc00db9ed943beb658c7d09e66f9be Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Volume tempest-invalid-1833633245 could not be found. Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'tempest-invalid-1833633245'} Jul 13 09:06:03.510112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1833633245 could not be found. (HTTP 404) (Request-ID: req-d530c146-1b57-494b-85f3-561dd6fcaf83) Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.511884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 09:06:03.513376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1833633245 could not be found. Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:03.516865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1833633245 could not be found. Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1833633245 could not be found. Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-73e2dfc8-7a6b-4670-ac51-232544a49e41 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Returning 404 to user: Volume tempest-invalid-1833633245 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-73e2dfc8-7a6b-4670-ac51-232544a49e41 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1833633245" status: 404 len: 99 microversion: 2.1 time: 0.534064 Jul 13 09:06:03.520327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1217 bytes} [Wed Jul 13 09:06:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1833633245 => generated 99 bytes in 536 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 13 09:06:03.521254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-86ac7a8b-5511-47c6-96d1-8f15164d5039 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007935 Jul 13 09:06:03.521254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1139 bytes} [Wed Jul 13 09:06:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 13 09:06:03.521254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-70cd6f10-002a-435f-a47c-e10feea86593 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007370 Jul 13 09:06:03.521254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 6/6] 10.222.0.40 () {58 vars in 1136 bytes} [Wed Jul 13 09:06:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 13 09:06:03.521254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-07ccd07e-95c1-43f7-9590-93a43a318ef9 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Calling method '.version_select at 0x7fad23707ee0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:03.700443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-07ccd07e-95c1-43f7-9590-93a43a318ef9 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] HTTP exception thrown: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-07ccd07e-95c1-43f7-9590-93a43a318ef9 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Request method failure captured: Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: DELETE /compute/v2.1/os-volumes/a1a85f9b-0c8d-447b-be56-1d88e70c91d6 HTTP/1.1 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor4TUrBVRZEK47xVwBdfXvv43V-Q2dt2MC-GeYG0AHhuhC6NDbx5MI45SuJOWv8rDrmMAUdGldbT4k-qbednyQGUcEicOLRys7y9dH8dA_Ha7XkaZK3n9CbrtqqgJGCsAjaAWD4qAHcQyd77nIKzKLbQUdkQ132ap4-DXcENhNkap4 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:03.703822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b9915e7547ac42f89570543def2962b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b9915e7547ac42f89570543def2962b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3dcc00db9ed943beb658c7d09e66f9be Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'a1a85f9b-0c8d-447b-be56-1d88e70c91d6'} Jul 13 09:06:03.705320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. (HTTP 404) (Request-ID: req-14887ae3-65d5-457d-bd17-5689ae19ca4a) Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.707566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 09:06:03.708420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 13 09:06:03.711452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-07ccd07e-95c1-43f7-9590-93a43a318ef9 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Returning 404 to user: Volume a1a85f9b-0c8d-447b-be56-1d88e70c91d6 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-07ccd07e-95c1-43f7-9590-93a43a318ef9 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/a1a85f9b-0c8d-447b-be56-1d88e70c91d6" status: 404 len: 109 microversion: 2.1 time: 0.333101 Jul 13 09:06:03.712814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 7/7] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:06:03 2022] DELETE /compute/v2.1/os-volumes/a1a85f9b-0c8d-447b-be56-1d88e70c91d6 => generated 109 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:06:03.715454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4cf7efed-5da5-431f-bee3-c33bc5de6238 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Calling method '.version_select at 0x7fad237224c0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:03.867384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-4cf7efed-5da5-431f-bee3-c33bc5de6238 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] HTTP exception thrown: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4cf7efed-5da5-431f-bee3-c33bc5de6238 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Request method failure captured: Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/os-volumes/1ea30ae5-24eb-40c6-8171-0ebc228e05a3 HTTP/1.1 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor4TUrBVRZEK47xVwBdfXvv43V-Q2dt2MC-GeYG0AHhuhC6NDbx5MI45SuJOWv8rDrmMAUdGldbT4k-qbednyQGUcEicOLRys7y9dH8dA_Ha7XkaZK3n9CbrtqqgJGCsAjaAWD4qAHcQyd77nIKzKLbQUdkQ132ap4-DXcENhNkap4 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:03.869349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b9915e7547ac42f89570543def2962b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b9915e7547ac42f89570543def2962b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b9915e7547ac42f89570543def2962b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: b9915e7547ac42f89570543def2962b2 Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-1436887014 Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3dcc00db9ed943beb658c7d09e66f9be Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-1436887014-project Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '1ea30ae5-24eb-40c6-8171-0ebc228e05a3'} Jul 13 09:06:03.870627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. (HTTP 404) (Request-ID: req-644d43f5-b315-4a5c-abe8-96ebe805da04) Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.871234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:03.872603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 09:06:03.873457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4cf7efed-5da5-431f-bee3-c33bc5de6238 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] Returning 404 to user: Volume 1ea30ae5-24eb-40c6-8171-0ebc228e05a3 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4cf7efed-5da5-431f-bee3-c33bc5de6238 tempest-VolumesNegativeTest-1436887014 tempest-VolumesNegativeTest-1436887014-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1ea30ae5-24eb-40c6-8171-0ebc228e05a3" status: 404 len: 109 microversion: 2.1 time: 0.159433 Jul 13 09:06:03.879017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 8/8] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:03 2022] GET /compute/v2.1/os-volumes/1ea30ae5-24eb-40c6-8171-0ebc228e05a3 => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:04.062282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9a37a635-0d91-455b-91c3-cea2a9218b79 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.044705 Jul 13 09:06:04.062282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 1/9] 10.222.0.40 () {60 vars in 1154 bytes} [Wed Jul 13 09:06:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4048 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 13 09:06:04.083014 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b900f42f-46cb-49c8-aa09-b9bdec32bf51 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237079d0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:04.263622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b900f42f-46cb-49c8-aa09-b9bdec32bf51 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 200 len: 345 microversion: 2.1 time: 0.193290 Jul 13 09:06:04.264625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 9/10] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:04 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:04.593146 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cbec2e19-a18f-4a9e-ba62-26d9b4e5232c tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad23785a60>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:04.661240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cbec2e19-a18f-4a9e-ba62-26d9b4e5232c tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9ac2d3a7-6d9e-4208-b8eb-6511451d8de7" status: 200 len: 350 microversion: 2.1 time: 0.073902 Jul 13 09:06:04.663665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 2/11] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:04 2022] GET /compute/v2.1/os-volumes/9ac2d3a7-6d9e-4208-b8eb-6511451d8de7 => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:05.276347 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4f1fde69-3e9d-42ea-ac3d-d9f97f6ff900 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad23722040>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:05.375640 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4f1fde69-3e9d-42ea-ac3d-d9f97f6ff900 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 200 len: 346 microversion: 2.1 time: 0.102946 Jul 13 09:06:05.376375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 10/12] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:05 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:05.388833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d10d9696-7fd3-41ba-a1b2-74098288b1f4 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Action: 'create', calling method: .version_select at 0x7fad23785b80>, body: {"snapshot": {"volume_id": "8172f87b-473b-4428-bd48-66a1f361c11c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-873360178"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:06.352534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d10d9696-7fd3-41ba-a1b2-74098288b1f4 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.967528 Jul 13 09:06:06.353093 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 3/13] 10.222.0.40 () {60 vars in 1161 bytes} [Wed Jul 13 09:06:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:06.366603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c884a2a0-cfb2-4396-a0b9-23ca4fc75f9e tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad236ba040>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:06.562759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c884a2a0-cfb2-4396-a0b9-23ca4fc75f9e tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 200 len: 286 microversion: 2.1 time: 0.203462 Jul 13 09:06:06.563309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 11/14] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:06 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 286 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:06.573545 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-aaebc36e-5205-40f9-a965-fa111b559e4b tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad23798790>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:06.681922 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1573fd8e-a569-4ddb-96d2-092a92c984a0 tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad236ba790>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:06.745408 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-aaebc36e-5205-40f9-a965-fa111b559e4b tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.174917 Jul 13 09:06:06.746220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 4/15] 10.222.0.40 () {58 vars in 1139 bytes} [Wed Jul 13 09:06:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:06.758446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-03dbd61e-acd6-40e0-a19b-e3ff1fbae974 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237a24c0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:06.857452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1573fd8e-a569-4ddb-96d2-092a92c984a0 tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e9b1d755-0d1d-495e-a107-92fcb4c65943" status: 200 len: 350 microversion: 2.1 time: 0.180835 Jul 13 09:06:06.858268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 12/16] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:06 2022] GET /compute/v2.1/os-volumes/e9b1d755-0d1d-495e-a107-92fcb4c65943 => generated 350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:06.912653 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-03dbd61e-acd6-40e0-a19b-e3ff1fbae974 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 200 len: 286 microversion: 2.1 time: 0.159479 Jul 13 09:06:06.914022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 5/17] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:06 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:07.727962 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-01f05c6f-cd2e-4a1d-ba5f-cabdf4bc2f5e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'create', calling method: .version_select at 0x7fad23707c10>, body: {"keypair": {"name": "tempest-keypair-777032774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKGLBDu5dZhyhee2ed5dIdJBsF119KV3wiqT4FAdl6AltxHvilQAWXJTvNEKKPOr4fjFm5B7T+CTQkKtUJwW/sz7XTpuErlh4A0H/8GubKmb4YAFJlAYvnKy08pgcUaIA=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:07.838466 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-01f05c6f-cd2e-4a1d-ba5f-cabdf4bc2f5e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:07.882754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-01f05c6f-cd2e-4a1d-ba5f-cabdf4bc2f5e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for user 1438ef91441f4493844a915ce12fcfa4 and project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:07.927044 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1527ed69-164f-492d-9344-0c037d1d9c1d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad23785af0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:08.026317 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1527ed69-164f-492d-9344-0c037d1d9c1d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 200 len: 286 microversion: 2.1 time: 0.104302 Jul 13 09:06:08.027070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 6/18] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:07 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:08.122857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-01f05c6f-cd2e-4a1d-ba5f-cabdf4bc2f5e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.070210 Jul 13 09:06:08.126387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 13/19] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Jul 13 09:06:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1072 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 13 09:06:09.037921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7e0ec636-7e2b-4d96-951c-f0f4ecd1c703 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237a2550>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:09.090367 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7e0ec636-7e2b-4d96-951c-f0f4ecd1c703 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 200 len: 286 microversion: 2.1 time: 0.056654 Jul 13 09:06:09.091396 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 7/20] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:09 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:10.114761 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7353ef27-d71b-4b38-855f-2b9d5f6b7a81 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad23681700>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.180357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7353ef27-d71b-4b38-855f-2b9d5f6b7a81 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 200 len: 287 microversion: 2.1 time: 0.077610 Jul 13 09:06:10.182099 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 14/21] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:10.193540 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-42a01428-9d1d-42af-ae71-36cdc88d214b tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237a2af0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.260082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-12cceecd-3192-4e60-bba0-5c054220e05b tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad23681dc0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.357172 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-12cceecd-3192-4e60-bba0-5c054220e05b tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/58d9535c-540e-4011-ad5b-1ab3c4de6ab5" status: 200 len: 351 microversion: 2.1 time: 0.101834 Jul 13 09:06:10.365032 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 15/22] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-volumes/58d9535c-540e-4011-ad5b-1ab3c4de6ab5 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:10.371535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6d832fa5-094c-480c-bde5-03850f587884 tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad23681d30>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.423434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-42a01428-9d1d-42af-ae71-36cdc88d214b tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 202 len: 0 microversion: 2.1 time: 0.234875 Jul 13 09:06:10.424270 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 8/23] 10.222.0.40 () {58 vars in 1253 bytes} [Wed Jul 13 09:06:10 2022] DELETE /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:06:10.435333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-303df5eb-17d5-4887-8706-4356714ab455 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237ac160>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.519494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-303df5eb-17d5-4887-8706-4356714ab455 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 200 len: 286 microversion: 2.1 time: 0.088443 Jul 13 09:06:10.519838 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 9/24] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:10.540744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6d832fa5-094c-480c-bde5-03850f587884 tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.173811 Jul 13 09:06:10.548632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 16/25] 10.222.0.40 () {58 vars in 1133 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:10.555312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b5cbaa96-0ebe-42f3-ac19-1445b79f45ed tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad237a2c10>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.699231 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b5cbaa96-0ebe-42f3-ac19-1445b79f45ed tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.147605 Jul 13 09:06:10.700297 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 10/26] 10.222.0.40 () {58 vars in 1148 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:10.713642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-05dd98dc-02f5-4d52-a487-121fba32ccdb tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad22e2f160>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:10.922533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-05dd98dc-02f5-4d52-a487-121fba32ccdb tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.213421 Jul 13 09:06:10.929641 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 17/27] 10.222.0.40 () {58 vars in 1133 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:10.935911 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4029a885-46b3-49e9-bef1-231a2e81b834 tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad237a2160>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:11.177696 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4029a885-46b3-49e9-bef1-231a2e81b834 tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.246647 Jul 13 09:06:11.178315 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 11/28] 10.222.0.40 () {58 vars in 1166 bytes} [Wed Jul 13 09:06:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:11.197683 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1a5bbabc-ed75-451a-8595-81d0acedb0aa tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad22e2fdc0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:11.399922 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1a5bbabc-ed75-451a-8595-81d0acedb0aa tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.212857 Jul 13 09:06:11.408314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 18/29] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Jul 13 09:06:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:11.412934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-146604d7-4ed6-4db1-9715-b14849ab58fb tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad237ac5e0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:11.539431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b267a184-9d3a-4690-9fa5-79dae7d34087 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad22e2f9d0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:11.647221 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-146604d7-4ed6-4db1-9715-b14849ab58fb tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.238027 Jul 13 09:06:11.647784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 12/30] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Jul 13 09:06:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:11.659923 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cab12cc4-098a-4a04-8d1b-05aa1d82fb1d tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad23785940>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:11.685756 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-b267a184-9d3a-4690-9fa5-79dae7d34087 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] HTTP exception thrown: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b267a184-9d3a-4690-9fa5-79dae7d34087 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Request method failure captured: Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 HTTP/1.1 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor3xM1o5C0NxEe9HYRncZe3ckElwZs8DaXh-p0R-HU5nEM6D2H5iTb9WTcxRDN7w1hdISIQWarxbmZ55ioHqAj-oQM-iryEUs8pIF9Ku7pU8iCXnMHdkcjPq0ysUpE41e1QWrZawYdoH1ML3yjT_2J7pCcykKtNXynOtBOI4OfWYB0 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:06:11.689127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 3121e6920b424e01a44bf057d82ebcbc Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '37a47fe0-219b-4cb0-a29a-d15d0abdeca0'} Jul 13 09:06:11.691152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. (HTTP 404) (Request-ID: req-be272cdd-0bec-4752-8302-053f90848301) Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.692005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:11.693265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 13 09:06:11.694705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b267a184-9d3a-4690-9fa5-79dae7d34087 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Returning 404 to user: Snapshot 37a47fe0-219b-4cb0-a29a-d15d0abdeca0 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:11.696071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b267a184-9d3a-4690-9fa5-79dae7d34087 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0" status: 404 len: 111 microversion: 2.1 time: 0.163830 Jul 13 09:06:11.697115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 19/31] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Jul 13 09:06:11 2022] GET /compute/v2.1/os-snapshots/37a47fe0-219b-4cb0-a29a-d15d0abdeca0 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:11.705381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3872dbe2-ff38-44ea-ba4d-dc86c7f93cc3 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad23681550>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:11.847813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cab12cc4-098a-4a04-8d1b-05aa1d82fb1d tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.191522 Jul 13 09:06:11.849177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 13/32] 10.222.0.40 () {58 vars in 1187 bytes} [Wed Jul 13 09:06:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:11.860898 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bdf4fa2f-df95-4a30-9155-ba5e0a2222df tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] Calling method '.version_select at 0x7fad237a20d0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:12.131100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bdf4fa2f-df95-4a30-9155-ba5e0a2222df tempest-VolumesTestJSON-881135592 tempest-VolumesTestJSON-881135592-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.274156 Jul 13 09:06:12.131929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 14/33] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Jul 13 09:06:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:12.155766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3872dbe2-ff38-44ea-ba4d-dc86c7f93cc3 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 202 len: 0 microversion: 2.1 time: 0.454593 Jul 13 09:06:12.156831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 20/34] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:06:11 2022] DELETE /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:06:12.178081 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-68178851-ea10-4c3a-acc1-8381702f94e6 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237aca60>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:12.296954 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-68178851-ea10-4c3a-acc1-8381702f94e6 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 200 len: 345 microversion: 2.1 time: 0.135943 Jul 13 09:06:12.297921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 15/35] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:12 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:13.312548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1509b591-a392-4646-91c2-d9a80be9fe8d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad22e2f430>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:13.441410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1509b591-a392-4646-91c2-d9a80be9fe8d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 200 len: 345 microversion: 2.1 time: 0.125831 Jul 13 09:06:13.441410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 21/36] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:13 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:14.444801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-39b579d2-ba43-43e4-8989-d39d8b632576 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad23785af0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:14.546252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-39b579d2-ba43-43e4-8989-d39d8b632576 tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 200 len: 345 microversion: 2.1 time: 0.105401 Jul 13 09:06:14.546812 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 16/37] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:14 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:15.559409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fb65ff94-8ef7-459e-b86f-0d140c51de3d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237ac940>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:15.584817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-841493436", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "networks": [{"uuid": "0fe0cfc8-a852-4bd7-8f2a-f57d730ea287"}]}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:15.611086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-fb65ff94-8ef7-459e-b86f-0d140c51de3d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] HTTP exception thrown: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fb65ff94-8ef7-459e-b86f-0d140c51de3d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Request method failure captured: Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c HTTP/1.1 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor3xM1o5C0NxEe9HYRncZe3ckElwZs8DaXh-p0R-HU5nEM6D2H5iTb9WTcxRDN7w1hdISIQWarxbmZ55ioHqAj-oQM-iryEUs8pIF9Ku7pU8iCXnMHdkcjPq0ysUpE41e1QWrZawYdoH1ML3yjT_2J7pCcykKtNXynOtBOI4OfWYB0 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:06:15.637520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 3121e6920b424e01a44bf057d82ebcbc Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '8172f87b-473b-4428-bd48-66a1f361c11c'} Jul 13 09:06:15.640285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. (HTTP 404) (Request-ID: req-96aea183-c66d-40ca-be21-d12601dfcd8d) Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.641014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:15.641883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 09:06:15.642791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fb65ff94-8ef7-459e-b86f-0d140c51de3d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Returning 404 to user: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fb65ff94-8ef7-459e-b86f-0d140c51de3d tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 404 len: 109 microversion: 2.1 time: 0.064292 Jul 13 09:06:15.644787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 17/38] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:15 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:15.646683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3790fbc9-c2ac-4c4e-ac37-15212c3b12ed tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad2370e310>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:15.741998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-3790fbc9-c2ac-4c4e-ac37-15212c3b12ed tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] HTTP exception thrown: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3790fbc9-c2ac-4c4e-ac37-15212c3b12ed tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Request method failure captured: Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c HTTP/1.1 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor3xM1o5C0NxEe9HYRncZe3ckElwZs8DaXh-p0R-HU5nEM6D2H5iTb9WTcxRDN7w1hdISIQWarxbmZ55ioHqAj-oQM-iryEUs8pIF9Ku7pU8iCXnMHdkcjPq0ysUpE41e1QWrZawYdoH1ML3yjT_2J7pCcykKtNXynOtBOI4OfWYB0 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:06:15.744034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 3121e6920b424e01a44bf057d82ebcbc Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '8172f87b-473b-4428-bd48-66a1f361c11c'} Jul 13 09:06:15.745086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. (HTTP 404) (Request-ID: req-9d66ec50-bc94-4528-9a09-69ae5c357823) Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.745807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 13 09:06:15.746910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 13 09:06:15.747795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3790fbc9-c2ac-4c4e-ac37-15212c3b12ed tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Returning 404 to user: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3790fbc9-c2ac-4c4e-ac37-15212c3b12ed tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 404 len: 109 microversion: 2.1 time: 0.106708 Jul 13 09:06:15.751702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 18/39] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:06:15 2022] DELETE /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:15.761622 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-24fc844f-c3e0-47a0-8fab-93b3da3c71ef tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Calling method '.version_select at 0x7fad237ac4c0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:15.819854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] validate_networks() for [('0fe0cfc8-a852-4bd7-8f2a-f57d730ea287', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:06:15.848613 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-24fc844f-c3e0-47a0-8fab-93b3da3c71ef tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] HTTP exception thrown: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-24fc844f-c3e0-47a0-8fab-93b3da3c71ef tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Request method failure captured: Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c HTTP/1.1 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor3xM1o5C0NxEe9HYRncZe3ckElwZs8DaXh-p0R-HU5nEM6D2H5iTb9WTcxRDN7w1hdISIQWarxbmZ55ioHqAj-oQM-iryEUs8pIF9Ku7pU8iCXnMHdkcjPq0ysUpE41e1QWrZawYdoH1ML3yjT_2J7pCcykKtNXynOtBOI4OfWYB0 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:06:15.850581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/537f3a6f839948638c78cd68ff9fcf24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 537f3a6f839948638c78cd68ff9fcf24 Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2130301687 Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 3121e6920b424e01a44bf057d82ebcbc Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2130301687-project Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '8172f87b-473b-4428-bd48-66a1f361c11c'} Jul 13 09:06:15.851633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. (HTTP 404) (Request-ID: req-409faad4-d957-464d-bff0-b828c466b712) Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.852306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:06:15.857031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 09:06:15.857922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-24fc844f-c3e0-47a0-8fab-93b3da3c71ef tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] Returning 404 to user: Volume 8172f87b-473b-4428-bd48-66a1f361c11c could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-24fc844f-c3e0-47a0-8fab-93b3da3c71ef tempest-VolumesSnapshotsTestJSON-2130301687 tempest-VolumesSnapshotsTestJSON-2130301687-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c" status: 404 len: 109 microversion: 2.1 time: 0.100770 Jul 13 09:06:15.859140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:06:15 2022] GET /compute/v2.1/os-volumes/8172f87b-473b-4428-bd48-66a1f361c11c => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:16.901775 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1351904993", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dced4119-fd64-48f2-a32b-f0864c860758"}], "security_groups": [{"name": "tempest-securitygroup--809531645"}], "key_name": "tempest-keypair-777032774", "user_data": "}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:17.244688 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] validate_networks() for [('dced4119-fd64-48f2-a32b-f0864c860758', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:06:17.938087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=4 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:17.961398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:06:17.961838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:06:17.962353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:06:17.962836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:06:17.963253 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:06:17.975811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:17.976704 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:17.977736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:17.978550 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:18.008846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Getting quotas for project 461a578ac4d44ffc9284d56a09d6c18e. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:18.013373 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Getting quotas for user 9f6eb40fbef34931b668330b9f4db27d and project 461a578ac4d44ffc9284d56a09d6c18e. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:18.028951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:06:18.031988 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:06:18.245197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-95cc9141-e6e3-4fe0-a433-6046a8a1be0b tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.153247 Jul 13 09:06:18.255150 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 22/41] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:06:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:06:18.409796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:06:18.410480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:06:18.410965 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:06:18.411378 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:06:18.411784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:06:18.441610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:18.467083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:18.468073 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:18.468521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:18.548162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:18.561240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for user 1438ef91441f4493844a915ce12fcfa4 and project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:18.613149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c72cc481-8de5-4fa9-a7b8-8e85f7e5c69d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: .version_select at 0x7fad22e2ef70>, body: {"keypair": {"name": "tempest-keypair-943858323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEWid6mJcUuZdrOeiSmRVBtjuQZKJO6tvAU8BYmpqKEjvpOgKm953gLzjaavqWR3iHHhJ8QTD43ls+VN85YUHBw5GWXBA+xFbTAkftDjRho1uF9sEBnNn3EL8kyyJjzMg=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:18.617751 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:06:18.622205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:06:18.636148 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-c72cc481-8de5-4fa9-a7b8-8e85f7e5c69d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for project eb9e230019f042dbbc680fc3b1340d41. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:18.643918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-c72cc481-8de5-4fa9-a7b8-8e85f7e5c69d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for user 35c7c83855084c188ab8a6dacb57a24b and project eb9e230019f042dbbc680fc3b1340d41. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:18.820025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c72cc481-8de5-4fa9-a7b8-8e85f7e5c69d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.562957 Jul 13 09:06:18.821439 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 23/42] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:06:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:18.901504 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1b7f5a4c-30dc-4319-b6bf-541b6648aa74 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.004480 Jul 13 09:06:18.902213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 20/43] 10.222.0.40 () {62 vars in 1187 bytes} [Wed Jul 13 09:06:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 13 09:06:18.910586 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-db8e2153-ec78-4b9a-9ce3-2a8ef55c3b57 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:18.911649 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-db8e2153-ec78-4b9a-9ce3-2a8ef55c3b57 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:19.163226 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-db8e2153-ec78-4b9a-9ce3-2a8ef55c3b57 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:19.202042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-db8e2153-ec78-4b9a-9ce3-2a8ef55c3b57 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1214 microversion: 2.1 time: 0.294444 Jul 13 09:06:19.204616 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 21/44] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:18 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:19.220236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6b6a37da-925a-4e4e-9c19-b47537657224 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:19.227863 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6b6a37da-925a-4e4e-9c19-b47537657224 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:19.384899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6b6a37da-925a-4e4e-9c19-b47537657224 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:19.399435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6b6a37da-925a-4e4e-9c19-b47537657224 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:19.405521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6b6a37da-925a-4e4e-9c19-b47537657224 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:19.407445 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6b6a37da-925a-4e4e-9c19-b47537657224 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1281 microversion: 2.20 time: 0.201593 Jul 13 09:06:19.408158 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:19 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:19.456855 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-45263979", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:19.567537 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] validate_networks() for [('66664860-8484-4278-a13a-d19d7f467709', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:06:20.224431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a182a672-2816-4935-83f5-bc6875485897 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:20.225919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a182a672-2816-4935-83f5-bc6875485897 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:20.547608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a182a672-2816-4935-83f5-bc6875485897 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:20.557988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a182a672-2816-4935-83f5-bc6875485897 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1214 microversion: 2.1 time: 0.341054 Jul 13 09:06:20.566679 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 23/46] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:20 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:20.585348 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e1cf1e57-ec77-4047-944a-0c000af7b1a5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:20.589146 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e1cf1e57-ec77-4047-944a-0c000af7b1a5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:21.325632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:06:21.326285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:06:21.326830 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:06:21.327364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:06:21.328558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:06:21.380872 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:21.381406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:21.387200 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:21.390073 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:21.478921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for project 7afbdee349034d2182240f1f7230236f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:21.508230 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for user d9bffb24cf26486a9a8947882b52ec98 and project 7afbdee349034d2182240f1f7230236f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:21.545924 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1cf1e57-ec77-4047-944a-0c000af7b1a5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:21.555719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:06:21.555921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1cf1e57-ec77-4047-944a-0c000af7b1a5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:21.557424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1cf1e57-ec77-4047-944a-0c000af7b1a5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:21.564321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:06:21.574762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e1cf1e57-ec77-4047-944a-0c000af7b1a5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1281 microversion: 2.20 time: 1.005220 Jul 13 09:06:21.575370 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 24/47] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:20 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1281 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:21.595728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3110c6c6-abed-4352-a632-71feecccfb5d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:21.596390 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3110c6c6-abed-4352-a632-71feecccfb5d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:21.823038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3110c6c6-abed-4352-a632-71feecccfb5d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:21.830319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3110c6c6-abed-4352-a632-71feecccfb5d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1214 microversion: 2.1 time: 0.251109 Jul 13 09:06:21.833302 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:21 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:21.863340 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8404f7d7-1f02-41db-b37c-f7a8dd8ed688 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.036611 Jul 13 09:06:21.864060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:06:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:06:21.877690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0580f884-6501-443e-8ecb-17ee5c989b67 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:21.878404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0580f884-6501-443e-8ecb-17ee5c989b67 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:22.016529 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0580f884-6501-443e-8ecb-17ee5c989b67 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:22.027312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0580f884-6501-443e-8ecb-17ee5c989b67 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1220 microversion: 2.1 time: 0.153196 Jul 13 09:06:22.030106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 26/50] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:21 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1220 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:22.448720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1465370663", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:22.547877 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] validate_networks() for [('66664860-8484-4278-a13a-d19d7f467709', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:06:22.594993 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:22.595748 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:22.608684 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:22.609292 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:22.613483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:22.616404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:23.196438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:23.264316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:23.269292 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:23.274067 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-aa56fd8e-5737-4de0-bdd7-44abac7f5fad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1285 microversion: 2.20 time: 0.682849 Jul 13 09:06:23.276776 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 27/51] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:22 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1285 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:23.283629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:23.285127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:23.296245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:23.297608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:23.299789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:23.300953 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:23.569014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:23.584650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7f75ddff-8387-4e8f-a4b7-772cbdb40b96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1210 microversion: 2.1 time: 0.306203 Jul 13 09:06:23.586269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 28/52] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:23 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1210 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:23.883602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:06:23.884733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:06:23.885628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:06:23.886647 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:06:23.887288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:06:23.911250 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:23.911714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:23.912532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:23.912978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:23.953405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for project 7afbdee349034d2182240f1f7230236f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:23.959906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for user d9bffb24cf26486a9a8947882b52ec98 and project 7afbdee349034d2182240f1f7230236f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:23.977733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:06:23.982064 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:06:24.137377 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5bf6703d-3f3b-45ce-ae05-96521be1b077 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.693419 Jul 13 09:06:24.138054 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 25/53] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:06:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:06:24.149924 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-10d7ed0c-f950-4431-bada-8267669d848d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:24.151494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-10d7ed0c-f950-4431-bada-8267669d848d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:24.296638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:24.303537 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:24.332742 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:24.342538 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:24.343492 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:24.343949 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:24.778512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-10d7ed0c-f950-4431-bada-8267669d848d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:24.793707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-10d7ed0c-f950-4431-bada-8267669d848d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1222 microversion: 2.1 time: 0.641687 Jul 13 09:06:24.795948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 29/54] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:24 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1222 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:24.816829 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:24.818247 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:24.854258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:24.855000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:24.856892 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:24.860736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:25.049818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:25.080962 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:25.084856 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:25.089861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ec183933-0a01-446f-b6dd-594f47d8ce29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1333 microversion: 2.20 time: 0.797095 Jul 13 09:06:25.099367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 26/55] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:24 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1333 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:25.251049 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:25.270221 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-71389b51-1248-4afb-8fd1-d4e9acd17950 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1274 microversion: 2.1 time: 0.470518 Jul 13 09:06:25.270833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 30/56] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:24 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1274 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:25.814005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:25.815402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:25.879975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:25.881542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:25.882464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:25.882919 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:26.120288 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:26.120288 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:26.124095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:26.124822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:26.127936 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:26.128608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:26.253377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:26.268360 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:26.269907 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:26.295435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0c0a4674-b308-44de-88d4-79ae03f25e7c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1339 microversion: 2.20 time: 0.167719 Jul 13 09:06:26.302310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 31/57] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:26 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:26.317921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:26.321515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:26.336092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:26.340257 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:26.353488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:26.354150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:26.616228 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:26.629857 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4688c3de-853b-4921-9a59-d49eccf6c40d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1272 microversion: 2.1 time: 0.321586 Jul 13 09:06:26.629857 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 32/58] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:26 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:26.699385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:26.718609 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e9a1eaae-1ab1-41a1-b723-520b0d758c41 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1226 microversion: 2.1 time: 0.903909 Jul 13 09:06:26.737306 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 27/59] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:25 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1226 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:26.887251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-851299010", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "862d32ef-d286-4010-a420-61dff25da7b3"}], "security_groups": [{"name": "tempest-securitygroup--477265680"}], "key_name": "tempest-keypair-943858323", "user_data": "}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:27.315968 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:27.318879 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:27.362165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:27.362165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:27.362165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:27.362165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:27.803200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] validate_networks() for [('862d32ef-d286-4010-a420-61dff25da7b3', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:06:28.517350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:29.397212 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:29.408850 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:29.416615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:29.422165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bc0a1eb4-9234-4952-8547-62e1deb08aad tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 2.111467 Jul 13 09:06:29.423407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 28/60] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:27 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:29.434522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:29.436955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:29.450916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:29.451617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:29.460223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:29.477497 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:29.887478 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:29.898920 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b7a1f163-3f7d-4b99-9aed-b0be0ce3cde1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.471355 Jul 13 09:06:29.910864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 29/61] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:29 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:29.919007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:29.921175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:29.936309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:29.942646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:29.942646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:29.942646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:30.106116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:30.110192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e25dc2e3-8e32-4ae2-92f6-9f6893302376 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1280 microversion: 2.1 time: 0.200469 Jul 13 09:06:30.121177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 30/62] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:29 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:30.199374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:06:30.199888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:06:30.200270 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:06:30.200680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:06:30.201092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:06:30.230983 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:30.231375 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:30.232244 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:30.240787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:30.389626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for project eb9e230019f042dbbc680fc3b1340d41. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:06:30.417480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for user 35c7c83855084c188ab8a6dacb57a24b and project eb9e230019f042dbbc680fc3b1340d41. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:06:30.442809 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:30.444130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:30.461079 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:30.461901 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:30.471220 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:30.471220 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:30.512625 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:06:30.520574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:06:30.790437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5d7b8b42-dd92-443b-aef9-7b00460a646e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.908377 Jul 13 09:06:30.796734 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 33/63] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:06:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 3915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:06:30.814331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f16a22e9-2c12-4dd5-ad98-4500b6a5cbec tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:30.818247 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f16a22e9-2c12-4dd5-ad98-4500b6a5cbec tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:31.188450 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f16a22e9-2c12-4dd5-ad98-4500b6a5cbec tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:31.197221 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f16a22e9-2c12-4dd5-ad98-4500b6a5cbec tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1236 microversion: 2.1 time: 0.399341 Jul 13 09:06:31.211938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 34/64] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:30 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1236 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:31.211938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:31.211938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:31.246425 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:31.248546 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:31.249438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:31.250627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:31.308626 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:31.326702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:31.328890 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:31.334437 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-eab016e6-c576-44bd-8a39-0fa1e2bc63d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.896151 Jul 13 09:06:31.349403 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 31/65] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:30 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:31.360394 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:31.364679 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:31.384722 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:31.385506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:31.387476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:31.390092 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:32.023358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:32.040482 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6fb3ab42-74bb-4059-8048-8799d14a1ccc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1280 microversion: 2.1 time: 0.685193 Jul 13 09:06:32.042950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 32/66] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:31 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1280 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:32.222334 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-892322f5-097f-4908-ac98-51a16ca41a45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:32.223174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-892322f5-097f-4908-ac98-51a16ca41a45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:32.225509 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=11 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:32.460195 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-892322f5-097f-4908-ac98-51a16ca41a45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:32.484875 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:32.495227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-892322f5-097f-4908-ac98-51a16ca41a45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1236 microversion: 2.1 time: 0.278673 Jul 13 09:06:32.498239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:32 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1236 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:32.499277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3ed5c1c6-fe95-4b36-a7cd-fb1d35f2e705 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 1.294718 Jul 13 09:06:32.502391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 35/68] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:31 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:32.511365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:32.524050 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:32.536541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:32.536995 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:32.537778 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:32.538240 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:33.060590 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:33.066915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:33.091930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:33.095126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:33.097281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:33.105581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:33.149918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:33.186695 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:33.190798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:33.195602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-563ba191-6ab9-4c02-a5f3-821ac731d7d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.694336 Jul 13 09:06:33.196406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 34/69] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:32 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:33.519261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:33.520195 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:33.539746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:33.543459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:33.544282 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:33.544718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:33.799813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:33.809541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6c97829e-a143-4efd-af90-a831e47142e1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.753335 Jul 13 09:06:33.816242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 36/70] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:33 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:33.828599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:33.846322 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:33.846322 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:33.847067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d14b0b83-b4d5-47fe-a933-49987a2b47bb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1232 microversion: 2.1 time: 0.335792 Jul 13 09:06:33.847067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 35/71] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:33 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1232 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:33.858155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:33.858799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:33.859847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:33.860474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:34.153302 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:34.162088 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dcc462bb-249b-4f35-8112-58a224a00aa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.344419 Jul 13 09:06:34.167893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:33 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:34.228642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:34.229335 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:34.231303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:34.257328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:34.266224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:34.266224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:34.266224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:34.832765 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:34.833382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:34.853939 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:34.856601 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:34.868925 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:34.871022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:35.330621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:35.359962 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:35.361680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:35.363114 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-181b5a8f-d162-42f1-b7fa-93004d5c0d9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 1.145320 Jul 13 09:06:35.363688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 36/73] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:34 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:35.385190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:35.397654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:35.410296 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:35.410804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:35.411631 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:35.412096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:35.608586 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:35.624924 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-749ed5a2-2c5d-4eb4-987b-1641a752d174 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1306 microversion: 2.1 time: 0.252431 Jul 13 09:06:35.625662 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 37/74] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:35 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1306 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:35.632854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:35.636535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:35.656745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:35.657481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:35.658733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:35.659394 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:35.787610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:35.806114 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7037df8c-63d9-4b6e-8687-1396bf064a39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.977621 Jul 13 09:06:35.806872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 38/75] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:34 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:35.896450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:35.925719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-45040eb9-3d66-4517-b067-b4e6348b5cfd tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.279577 Jul 13 09:06:35.925719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 38/76] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:35 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:35.933083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-2f34ad5f-27fd-4c6f-bc41-c95f612c6aa8 req-fff5c6bd-1f05-494f-86d0-d5ac77302a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:35.967046 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2f34ad5f-27fd-4c6f-bc41-c95f612c6aa8 req-fff5c6bd-1f05-494f-86d0-d5ac77302a04 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:35.967482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2f34ad5f-27fd-4c6f-bc41-c95f612c6aa8 req-fff5c6bd-1f05-494f-86d0-d5ac77302a04 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.040361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-2f34ad5f-27fd-4c6f-bc41-c95f612c6aa8 req-fff5c6bd-1f05-494f-86d0-d5ac77302a04 service nova] Creating event network-changed:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:06:36.041296 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2f34ad5f-27fd-4c6f-bc41-c95f612c6aa8 req-fff5c6bd-1f05-494f-86d0-d5ac77302a04 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118253) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 13 09:06:36.052721 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.053886 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.055357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.058625 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.081901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.compute.rpcapi [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 13 09:06:36.084974 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=118253) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 13 09:06:36.108402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0314dbd2-41d5-402c-b18f-ed3e71fe26c6 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299852 Jul 13 09:06:36.116154 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 39/77] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:36.233728 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-9c1e0f5c-9c80-417e-818a-3f6395803d3b req-33c5fe45-a39d-4ff5-8d49-5c2cb82ea2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503d3aeb-a476-4caf-afa3-c4311d6ac263", "tag": "69be1990-5762-4324-89fe-b1139a371704"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:36.277363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9c1e0f5c-9c80-417e-818a-3f6395803d3b req-33c5fe45-a39d-4ff5-8d49-5c2cb82ea2a0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.279336 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9c1e0f5c-9c80-417e-818a-3f6395803d3b req-33c5fe45-a39d-4ff5-8d49-5c2cb82ea2a0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.382837 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:36.383608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:36.418276 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.418686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-9c1e0f5c-9c80-417e-818a-3f6395803d3b req-33c5fe45-a39d-4ff5-8d49-5c2cb82ea2a0 service nova] Creating event network-changed:69be1990-5762-4324-89fe-b1139a371704 for instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 on hv-cinder-84962 Jul 13 09:06:36.419789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.420713 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9c1e0f5c-9c80-417e-818a-3f6395803d3b req-33c5fe45-a39d-4ff5-8d49-5c2cb82ea2a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118252) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 13 09:06:36.427573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.427573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.428019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.428019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.429820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.431637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.463770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.compute.rpcapi [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 13 09:06:36.463770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] Releasing lock "compute-rpcapi-router" {{(pid=118252) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 13 09:06:36.506060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b230cd6c-ed3c-476b-aad7-1489b2551406 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581559 Jul 13 09:06:36.507173 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 39/78] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:36.650558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:36.657143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:36.665998 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.671712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:36.674470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:36.678572 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:37.004785 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:37.016885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-334838d2-c435-4786-8251-2dcd66a4dc12 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1294 microversion: 2.1 time: 0.377268 Jul 13 09:06:37.019702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 40/79] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:36 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1294 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:37.030468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:37.031341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:37.046281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:37.046744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:37.049682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:37.050160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.002793 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:38.013097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a3f989ce-9daf-4b24-88fa-abb4032bc6d5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.991795 Jul 13 09:06:38.020267 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 41/80] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:37 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:38.039227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:38.039227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:38.053095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:38.068039 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:38.087165 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:38.090789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:38.091003 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c0a30297-8dc0-433c-bf58-475139d9e5aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 1.712374 Jul 13 09:06:38.108871 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 40/81] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:36 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:38.110792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.115183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:38.117333 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.127686 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:38.128573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:38.168884 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:38.170251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.171155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:38.172054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.343065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:38.356383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fd9ab495-fe60-471d-a64c-999be337091f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1294 microversion: 2.1 time: 0.243368 Jul 13 09:06:38.359125 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 41/82] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:38 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:38.370502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-fb1b175e-cd9a-4b49-aff2-cd9314b1823e req-1fb64c8b-bef1-4e1d-915b-178b2fc6f301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4652c89f-12a1-40ec-86aa-705cb63de65f", "tag": "23fec340-ea0c-4bbf-a12c-354b4909fa75"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:38.388998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-fb1b175e-cd9a-4b49-aff2-cd9314b1823e req-1fb64c8b-bef1-4e1d-915b-178b2fc6f301 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:38.395488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-fb1b175e-cd9a-4b49-aff2-cd9314b1823e req-1fb64c8b-bef1-4e1d-915b-178b2fc6f301 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.419003 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-fb1b175e-cd9a-4b49-aff2-cd9314b1823e req-1fb64c8b-bef1-4e1d-915b-178b2fc6f301 service nova] Creating event network-changed:23fec340-ea0c-4bbf-a12c-354b4909fa75 for instance 4652c89f-12a1-40ec-86aa-705cb63de65f on hv-cinder-84962 Jul 13 09:06:38.431454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-fb1b175e-cd9a-4b49-aff2-cd9314b1823e req-1fb64c8b-bef1-4e1d-915b-178b2fc6f301 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067489 Jul 13 09:06:38.432675 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 42/83] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:38.572484 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-cfb1ee94-f8b4-4a77-a783-aa76eb1954b8 req-ca011a7e-ac64-4496-8ee1-eb6119321a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8315445c-678d-4c5c-8ecf-937e48a120a4", "tag": "d61129b0-9f79-4508-a968-7e3a740a1f1c"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:38.608535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-cfb1ee94-f8b4-4a77-a783-aa76eb1954b8 req-ca011a7e-ac64-4496-8ee1-eb6119321a29 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:38.609152 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-cfb1ee94-f8b4-4a77-a783-aa76eb1954b8 req-ca011a7e-ac64-4496-8ee1-eb6119321a29 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:38.632258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-cfb1ee94-f8b4-4a77-a783-aa76eb1954b8 req-ca011a7e-ac64-4496-8ee1-eb6119321a29 service nova] Creating event network-changed:d61129b0-9f79-4508-a968-7e3a740a1f1c for instance 8315445c-678d-4c5c-8ecf-937e48a120a4 on hv-cinder-84962 Jul 13 09:06:38.643631 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-cfb1ee94-f8b4-4a77-a783-aa76eb1954b8 req-ca011a7e-ac64-4496-8ee1-eb6119321a29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075081 Jul 13 09:06:38.644244 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 43/84] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:38.655079 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:38.659289 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:38.663898 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-56efacd4-2eb4-4538-904d-29f4897f9a31 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.641632 Jul 13 09:06:38.671154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 42/85] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:38 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:39.034973 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:39.035669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:39.050331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.050773 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.051548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.051978 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.113999 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:39.115386 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:39.122051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.122754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.129536 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.131249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.397713 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:39.417145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:39.420151 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:39.426797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-757d12cd-7c74-46de-88dd-538b0b4ab047 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.319562 Jul 13 09:06:39.429090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 43/86] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:39 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:39.437839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:39.440914 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:39.451900 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.452592 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.453522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.454121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.581196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:39.600985 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-19ea49cb-dd94-4375-9dc6-a5feda321d8e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1294 microversion: 2.1 time: 0.170655 Jul 13 09:06:39.612999 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 44/87] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:39 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1294 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:39.631830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:39.639743 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5e5ddf26-8228-4104-ba58-441bffe1847c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.609009 Jul 13 09:06:39.640772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 44/88] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:39 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:39.687573 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:39.688419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:39.700826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.701319 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:39.702123 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:39.702558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.195491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:40.195491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8629ccbe-34ab-435b-87ff-2571eb17cf37 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.436108 Jul 13 09:06:40.195491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 45/89] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:39 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:40.447148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:40.447742 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:40.449987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:40.456127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:40.456954 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.457896 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:40.458494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.630834 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:40.631698 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:40.640890 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:40.641710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.644717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:40.645508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.661415 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:40.665058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=89 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:40.673771 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:40.675394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:40.676589 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-52fc5080-48d1-405b-aec0-1b19737152b5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.233579 Jul 13 09:06:40.688029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 45/90] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:40 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:40.688029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:40.688029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:40.693901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:40.693901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.693901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:40.693901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:40.846911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:40.872505 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cce00d1e-dfd0-4479-905d-c28353d9a7a7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.235488 Jul 13 09:06:40.879820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 46/91] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:40 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:40.907913 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:40.916543 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b2511ef6-a0ac-434e-9c9d-c4309ff04e93 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.237081 Jul 13 09:06:40.925487 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 46/92] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:40 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:41.152580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:41.154707 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:41.182698 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:41.183878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:41.192021 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:41.194418 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:41.483627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:41.513206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-322d604b-19a7-40b3-b213-c0c942b10325 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.377244 Jul 13 09:06:41.526702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 47/93] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:41 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:41.704282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:41.711902 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:41.713401 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=28 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:41.719810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:41.720688 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:41.721563 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:41.721992 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:41.897722 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:41.899117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:41.908522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:41.910915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:41.910915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:41.911514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:41.981473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:41.991734 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:41.993950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:41.995258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-22e0ddcf-6989-4d0e-8978-cba9b0fe9297 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.302889 Jul 13 09:06:42.003149 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 47/94] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:41 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:42.025785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:42.026452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:42.038573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:42.039038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:42.040067 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:42.040933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:42.152205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:42.175025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0f111a47-05cc-40b4-bcd0-37427aded94d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.285234 Jul 13 09:06:42.176516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 48/95] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:41 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:42.229291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:42.241957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ce3a9eea-0cb4-4376-94cc-64fd9786cfb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.222989 Jul 13 09:06:42.242804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 48/96] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:42 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:42.293385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-7201864d-2090-4a48-8d60-becfa6a5c2b4 req-88101538-33a4-41aa-85fa-130424b1ea2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4e5e88-6062-46c0-92b1-4f21fe81b697", "tag": "97786c99-fd64-4d30-a6bd-7dffa045cb11"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:42.303359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-7201864d-2090-4a48-8d60-becfa6a5c2b4 req-88101538-33a4-41aa-85fa-130424b1ea2a service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:42.304140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-7201864d-2090-4a48-8d60-becfa6a5c2b4 req-88101538-33a4-41aa-85fa-130424b1ea2a service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:42.331508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-7201864d-2090-4a48-8d60-becfa6a5c2b4 req-88101538-33a4-41aa-85fa-130424b1ea2a service nova] Creating event network-changed:97786c99-fd64-4d30-a6bd-7dffa045cb11 for instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 on hv-cinder-84962 Jul 13 09:06:42.331508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-7201864d-2090-4a48-8d60-becfa6a5c2b4 req-88101538-33a4-41aa-85fa-130424b1ea2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040274 Jul 13 09:06:42.332127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 49/97] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:06:42.541037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:42.541666 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:42.547869 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:42.553768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:42.554693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:42.555229 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:42.704323 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:42.712826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1b4d9943-1a2f-461e-a5a7-347a1222af96 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.176059 Jul 13 09:06:42.713400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 49/98] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:42 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:43.010518 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=24 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:43.014742 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:43.015439 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:43.021850 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.022387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.023281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.023738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.164808 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:43.174231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:43.175921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:43.177040 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f7188d9e-dc63-47e9-b2de-2426abbc4789 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.167491 Jul 13 09:06:43.177914 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 50/99] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:43 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:43.193115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:43.194624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:43.200848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.204206 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.208273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.208967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.258479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:43.259101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:43.266466 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.267402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.268363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.268952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.387250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:43.395501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2989ab16-5529-411e-b069-9d39a375b8a5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.207227 Jul 13 09:06:43.396132 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 50/100] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:43 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:43.432172 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:43.443052 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-166d57bf-2298-498a-8135-00d127b390bc tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.185540 Jul 13 09:06:43.443052 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 51/101] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:43 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:43.729513 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:43.730244 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:43.736147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.736798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.743651 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:43.743651 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:43.875663 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:43.884568 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bf9f84ca-073f-45a2-86ee-620930d0e48d tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.158682 Jul 13 09:06:43.885885 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 51/102] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:43 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:44.196511 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:44.197137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:44.203448 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.204062 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.205496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.205925 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.344470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:44.353111 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:44.354969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:44.356180 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-52a8e092-5df2-4fb6-8f8a-780cacc37c07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.163621 Jul 13 09:06:44.366975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 52/103] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:44 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:44.412989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:44.413578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:44.419698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.420175 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.420929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.421356 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.458525 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:44.459425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:44.468966 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.469677 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.470804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.471488 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.600245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:44.607987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b7ab7b19-7d5f-426d-b64f-6c67aa157c48 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.198814 Jul 13 09:06:44.608557 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 52/104] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:44 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:44.647803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:44.655954 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6c0210cf-5af7-4bf7-a0f1-86860dda3436 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.202079 Jul 13 09:06:44.657127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 53/105] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:44 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:44.903239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:44.903852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:44.909859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.910338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:44.911090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:44.911519 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.043145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:45.051376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a472a5c2-b2ab-4305-9d83-ad07d05c2512 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.152111 Jul 13 09:06:45.051940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 53/106] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:44 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:45.375085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:45.375871 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:45.384456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:45.386756 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.389644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:45.389644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.555340 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:45.563385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:45.565700 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:45.566827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5b8977fe-7e2a-4929-b7ef-4262c2f00f26 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.196246 Jul 13 09:06:45.573867 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 54/107] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:45 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:45.624137 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:45.624734 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:45.631201 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:45.636882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.636882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:45.636882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.674794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:45.675474 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:45.681455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:45.681906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.682723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:45.683189 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:45.768431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:45.775872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5aa2e905-298f-4591-b5d9-74e73d3f93e0 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.155469 Jul 13 09:06:45.780473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 54/108] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:45 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:45.855826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:45.863927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-925be9c3-5db9-4ec7-80b0-1618b936335b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.193573 Jul 13 09:06:45.868038 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 55/109] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:45 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:46.068960 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:46.069714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:46.075454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=4 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:46.077690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.078174 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.088860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.088860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.213695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:46.220374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e5b2bc44-921e-400f-bc87-fa131b1281e0 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.155542 Jul 13 09:06:46.220910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 55/110] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:46 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:46.584963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:46.585574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:46.587558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:46.592514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.592961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.593723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.594190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.721019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:46.729179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:46.730806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:46.738013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3f575eb4-bc92-44f3-a412-71987e931cfd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.150862 Jul 13 09:06:46.738013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 56/111] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:46 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:46.793301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:46.793903 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:46.800888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.801327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.802100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.802530 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.880661 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:46.881444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:46.887981 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.888511 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.889350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:46.889859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:46.991486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:47.000052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2225c9fa-9f72-47d2-bef5-752d9b37f9a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.210561 Jul 13 09:06:47.002813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 56/112] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:46 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:47.035427 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:47.042891 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8bf6521e-4c84-4a38-8c7d-2e3b25e94ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.166957 Jul 13 09:06:47.043719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 57/113] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:46 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:47.238085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:47.238765 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:47.245126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:47.245573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:47.246368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:47.246796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:47.389676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:47.398150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-831bdd0a-0a0d-4a61-8c56-aa9072d7855c tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.165290 Jul 13 09:06:47.398721 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 57/114] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:47 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:47.754257 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:47.754879 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:47.761072 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:47.761526 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:47.762369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:47.762811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:47.898488 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:47.906815 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:47.910322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:47.910322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c1a2ec66-baa4-4d93-88b8-62d7b36433cf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.160507 Jul 13 09:06:47.910322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 58/115] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:47 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:48.021109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:48.022246 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:48.031843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.033031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.034934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.035526 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.060272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:48.060893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:48.072799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.073267 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.074444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.074910 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.274792 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:48.282731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-69436619-cf39-487e-a2ca-b5a352954b7a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.266774 Jul 13 09:06:48.284102 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 58/116] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:48 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:48.415161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:48.415807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:48.424583 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.434641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.435835 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.436360 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.510643 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:48.519975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-583f2ea7-013e-47c9-b4f8-41d4c7ef0276 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.463444 Jul 13 09:06:48.543533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 59/117] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:48 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:48.837580 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:48.846123 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-26c45a42-6707-4814-b1f6-65faa3269fa3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.434729 Jul 13 09:06:48.852343 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 59/118] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:48 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:06:48.928537 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:48.929862 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:48.936124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.936578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.937384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:48.937823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:48.942213 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:49.082452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:49.090483 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:49.091994 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:49.093315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d7168999-69c5-4af1-9fbb-ce82ebafc398 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.169708 Jul 13 09:06:49.093865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 60/119] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:48 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:49.300387 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:49.301055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:49.307869 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:49.313817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:49.314995 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:49.315484 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:49.483805 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:49.492341 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0bebe4a9-fd5b-4cde-bd12-652c785ef2e1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.196725 Jul 13 09:06:49.492930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 60/120] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:49 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:49.537608 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:49.538376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:49.544727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:49.545245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:49.545958 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:49.549919 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:49.677458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:49.684855 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a8a16ae1-9cdc-4833-9146-28957431aa99 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.151373 Jul 13 09:06:49.685435 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 61/121] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:49 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:49.867624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:49.868588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:49.874695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:49.875141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:49.876432 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:49.876864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.025293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:50.033455 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b558e8ab-c354-4a56-b892-44f7c8de75c3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.169491 Jul 13 09:06:50.034054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 61/122] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:49 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:50.114085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:50.114702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:50.121201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:50.121657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.122457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:50.122893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.258980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:50.272307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:50.273831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:50.274976 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e2aadfb6-4e5d-4841-94a8-d2ceca2970cc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.165091 Jul 13 09:06:50.275532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 62/123] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:50 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:50.509414 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:50.510078 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:50.515957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:50.516393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.517867 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:50.518342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.533648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:50.654173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:50.661978 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2c70bfc5-d577-4d11-941f-d32fabf20518 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.156669 Jul 13 09:06:50.662569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 62/124] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:50 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:50.701590 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:50.702353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:50.712492 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:50.712948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.713726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:50.714192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:50.846838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:50.854626 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cbd52964-87b5-44ec-8f99-e7fd6a79eb80 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.157191 Jul 13 09:06:50.855197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 63/125] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:50 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:51.058447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:51.058447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:51.058447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.058447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.058962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.058962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.194500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:51.202096 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1e988b5c-ca15-44e0-9701-48db3e760bb1 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.155640 Jul 13 09:06:51.202672 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 63/126] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:51 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:51.295075 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:51.295695 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:51.302996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.303497 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.304301 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.304906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.460945 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:51.470009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:51.471544 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:51.472643 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b239c35f-dba6-437c-8583-2863436f6d95 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.183289 Jul 13 09:06:51.473191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 64/127] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:51 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:06:51.678736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:51.679359 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:51.685344 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.685782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.686561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.686991 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.815078 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:51.822331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-179d8319-1696-4187-b597-edbfdfa366c6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.147463 Jul 13 09:06:51.822889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 64/128] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:51 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:51.871930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:51.872540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:51.879318 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.879769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:51.880527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:51.880963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:52.017075 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:52.024824 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5ac7c048-9ce7-4da7-9f11-7570b7c4d935 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.156616 Jul 13 09:06:52.025410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 65/129] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:51 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:52.226881 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:52.227483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:52.233619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:52.234083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:52.234840 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:52.236695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:52.369704 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:52.377609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-940dc569-9e29-4a2c-a043-f2608d70f457 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.154465 Jul 13 09:06:52.378434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 65/130] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:52 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:52.493707 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:52.493707 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:52.498902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:52.499401 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:52.500332 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:52.500822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:52.633130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:52.641822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:52.643499 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:52.644607 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ef1b49cf-f7c4-4000-a492-610e184a00d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.157212 Jul 13 09:06:52.645164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 66/131] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:52 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:52.840116 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:52.840648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:52.847036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:52.847484 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:52.848827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:52.849448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.013081 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:53.021853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f917728f-fc7a-40ee-baa9-8e0474c81ea7 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.186148 Jul 13 09:06:53.022817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 66/132] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:52 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:53.042280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:53.043039 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:53.052953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.053584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.054298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.054623 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.238144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:53.245866 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-93c48525-fb06-4903-abbc-d81a859848ce tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.207826 Jul 13 09:06:53.246483 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 67/133] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:53 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:53.293534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-6043e575-4896-465a-a569-e6b8de906c3e req-6fc93440-bafd-482d-acbf-a245851adcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "name": "network-vif-plugged", "status": "completed", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:53.302829 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-6043e575-4896-465a-a569-e6b8de906c3e req-6fc93440-bafd-482d-acbf-a245851adcec service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.303261 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-6043e575-4896-465a-a569-e6b8de906c3e req-6fc93440-bafd-482d-acbf-a245851adcec service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.313950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-6043e575-4896-465a-a569-e6b8de906c3e req-6fc93440-bafd-482d-acbf-a245851adcec service nova] Creating event network-vif-plugged:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:06:53.318980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-6043e575-4896-465a-a569-e6b8de906c3e req-6fc93440-bafd-482d-acbf-a245851adcec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103808 Jul 13 09:06:53.319599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 67/134] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:53.396046 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:53.396886 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:53.410304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.411081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.412014 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.412598 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.567167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:53.574641 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-467c5ce5-2b1c-41d7-897e-5cecfbbb8af2 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.183362 Jul 13 09:06:53.575205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 68/135] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:53 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:53.665144 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:53.666789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:53.686520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.689266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.690251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:53.691143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:53.916661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:53.930862 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:53.934572 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:53.937076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0a816aee-6772-41cd-90da-ae7495020d9d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.277899 Jul 13 09:06:53.938291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 68/136] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:53 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:54.039586 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:54.040210 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:54.046823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.047275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.048106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.048779 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.238421 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:54.247421 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c3777e11-6f52-4718-98ee-c2c64a65634e tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.211691 Jul 13 09:06:54.258117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 69/137] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:54 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:54.262756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:54.263361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:54.272890 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.277045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.277045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.277045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.437502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:54.447371 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f2845542-0560-4f2f-b4b9-f7fcd7903b47 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.188277 Jul 13 09:06:54.458025 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 69/138] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:54 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:54.592652 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:54.593264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:54.599984 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.600431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.601189 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.601622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.952352 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:54.957320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:54.958570 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:54.962771 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a1dc9957-3cc4-44ce-98b3-f4634c4ec146 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.373912 Jul 13 09:06:54.963589 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 70/139] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:54 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:54.972846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.972846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:54.972846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:54.972846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.139143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:55.147744 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:55.149251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:55.150382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5348a6c1-8e9c-4916-909d-a47f2e3954de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.198516 Jul 13 09:06:55.154083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 70/140] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:54 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:55.269161 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:55.269899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:55.276006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.276522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.277383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.277857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.337141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-eaf6da41-dfb4-4e8f-8a44-7a5e700faecd req-da0ce69b-6320-4e9a-99eb-2e8f474f5076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503d3aeb-a476-4caf-afa3-c4311d6ac263", "name": "network-vif-plugged", "status": "completed", "tag": "69be1990-5762-4324-89fe-b1139a371704"}, {"server_uuid": "8315445c-678d-4c5c-8ecf-937e48a120a4", "name": "network-vif-plugged", "status": "completed", "tag": "d61129b0-9f79-4508-a968-7e3a740a1f1c"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:55.347535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-eaf6da41-dfb4-4e8f-8a44-7a5e700faecd req-da0ce69b-6320-4e9a-99eb-2e8f474f5076 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.348658 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-eaf6da41-dfb4-4e8f-8a44-7a5e700faecd req-da0ce69b-6320-4e9a-99eb-2e8f474f5076 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.363007 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-eaf6da41-dfb4-4e8f-8a44-7a5e700faecd req-da0ce69b-6320-4e9a-99eb-2e8f474f5076 service nova] Creating event network-vif-plugged:69be1990-5762-4324-89fe-b1139a371704 for instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 on hv-cinder-84962 Jul 13 09:06:55.363518 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-eaf6da41-dfb4-4e8f-8a44-7a5e700faecd req-da0ce69b-6320-4e9a-99eb-2e8f474f5076 service nova] Creating event network-vif-plugged:d61129b0-9f79-4508-a968-7e3a740a1f1c for instance 8315445c-678d-4c5c-8ecf-937e48a120a4 on hv-cinder-84962 Jul 13 09:06:55.371830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-eaf6da41-dfb4-4e8f-8a44-7a5e700faecd req-da0ce69b-6320-4e9a-99eb-2e8f474f5076 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038384 Jul 13 09:06:55.372750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 71/141] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:55.430864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:55.439410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ca35f95a-057c-4cb1-8dd9-2c226f6ad42d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.174390 Jul 13 09:06:55.440003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 71/142] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:55 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:55.465991 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:55.466753 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:55.473804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.474582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.475612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.476337 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.657928 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:55.666263 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1ae3b33c-7bde-4854-ab17-de0d6dcd2fd2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.204985 Jul 13 09:06:55.666957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 72/143] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:55 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:55.979679 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:55.980880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:55.987263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.987708 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:55.988478 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:55.988915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.124812 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:56.135689 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-434ab707-e93c-4385-b196-250ca6906211 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.159707 Jul 13 09:06:56.136288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 72/144] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:55 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:56.168707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:56.170047 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:56.177709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:56.178506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.179730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:56.180364 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.328062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:56.336363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:56.337868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:56.339000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6635cd41-d170-4689-88f8-a54e85ed1f0a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.174162 Jul 13 09:06:56.339554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 73/145] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:56 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:56.465462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:56.466199 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:56.472338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:56.472786 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.473548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:56.473986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.610800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:56.620358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5c587c37-04e7-41ec-80fe-8b807004f4c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.162700 Jul 13 09:06:56.620358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 73/146] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:56 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:56.683545 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:56.684143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:56.691808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:56.692257 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.693041 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:56.693448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:56.836139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:56.845986 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fe88e972-0b32-41fd-8c19-71313ec72080 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.166189 Jul 13 09:06:56.850069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 74/147] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:56 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:57.153819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:57.154458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:57.160636 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.161096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.161866 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.162328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.317841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:57.326162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cf458661-6a55-45ee-84fd-cfedf9700f4f tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.176236 Jul 13 09:06:57.326740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 74/148] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:57 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:57.358165 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:57.358975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:57.365943 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.366426 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.367190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.367620 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.549438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:57.557948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:57.559480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:57.560613 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cd100749-d1d0-455c-adb9-e7fb01640754 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.207227 Jul 13 09:06:57.567555 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 75/149] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:57 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:57.636034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:57.637038 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:57.644059 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.644407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.645174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.645608 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.796518 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:57.809950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-17f6d579-12f6-4a64-921e-2ce0334bb070 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.177703 Jul 13 09:06:57.811185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 75/150] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:57 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:57.862413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:57.863109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:57.870117 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.870117 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:57.870799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:57.871320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:58.023062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:58.034795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8c487588-9729-4219-8cb6-92d69f1c296b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.176384 Jul 13 09:06:58.035451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 76/151] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:57 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:58.346626 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:58.347249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:58.353717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:58.354231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:58.355010 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:58.355441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:58.497907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:58.502176 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:58.506518 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a673e959-bd5c-4642-9753-204c0e7420d3 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1314 microversion: 2.1 time: 0.167004 Jul 13 09:06:58.507088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 76/152] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:58 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:58.583926 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:58.584678 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:58.591521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:58.592353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:58.593291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:58.593718 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:58.773207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:58.782724 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:58.785865 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:58.787705 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-64950f1f-1885-4213-ab38-ea9383e160df tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1406 microversion: 2.20 time: 0.208089 Jul 13 09:06:58.788608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 77/153] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:58 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:58.828279 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:58.829686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:58.844171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:58.844999 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:58.845652 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:58.846410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.023751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:59.034419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6a3ee71a-e444-4901-aa73-eb6c48e7f489 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.210582 Jul 13 09:06:59.043833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 77/154] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:58 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:59.052262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:59.053080 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:59.061991 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.062750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.063966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.064628 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.171798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-623ac037-d648-484b-8558-747152116190 req-cf3359af-1395-4d0b-b114-51eb64a80c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4e5e88-6062-46c0-92b1-4f21fe81b697", "name": "network-vif-plugged", "status": "completed", "tag": "97786c99-fd64-4d30-a6bd-7dffa045cb11"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:06:59.188510 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-623ac037-d648-484b-8558-747152116190 req-cf3359af-1395-4d0b-b114-51eb64a80c64 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.189160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-623ac037-d648-484b-8558-747152116190 req-cf3359af-1395-4d0b-b114-51eb64a80c64 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.209926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-623ac037-d648-484b-8558-747152116190 req-cf3359af-1395-4d0b-b114-51eb64a80c64 service nova] Creating event network-vif-plugged:97786c99-fd64-4d30-a6bd-7dffa045cb11 for instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 on hv-cinder-84962 Jul 13 09:06:59.215659 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-623ac037-d648-484b-8558-747152116190 req-cf3359af-1395-4d0b-b114-51eb64a80c64 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048372 Jul 13 09:06:59.216488 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 78/155] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:06:59.243612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:59.252887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f61e4c73-8d0e-4169-a160-316304c4cbd0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.205948 Jul 13 09:06:59.253790 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 78/156] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:59 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:59.524099 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:59.524795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:59.537051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.537413 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.538423 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.539047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.718427 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:59.726501 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b50b6980-17c6-414e-b79f-90f9e0f224f9 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1501 microversion: 2.1 time: 0.206771 Jul 13 09:06:59.727078 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 79/157] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:06:59 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:06:59.808649 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:59.809160 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:06:59.815767 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.816215 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.816982 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:06:59.817417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:06:59.961950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:59.971416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:59.973085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:06:59.975043 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7a490528-eeaa-46b2-88c5-774bf8ec18fb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1598 microversion: 2.20 time: 0.169798 Jul 13 09:06:59.988843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 79/158] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:06:59 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:06:59.993455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:06:59.993940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:00.009273 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:00.009714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:00.010505 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:00.011053 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:00.052089 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:00.053327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:00.060951 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:00.061669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:00.062651 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:00.064351 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:00.083059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:00.129587 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-97de37ab-e97e-4514-988a-d0054c6ae1fa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139957 Jul 13 09:07:00.130910 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 80/159] 10.222.0.40 () {60 vars in 1315 bytes} [Wed Jul 13 09:06:59 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:07:00.262250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:00.271839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:00.272415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:00.280565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:00.281018 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:00.281843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:00.282567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:00.284240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2d22ba36-5721-4656-bfbf-120b8bb0288c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.234823 Jul 13 09:07:00.286119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 80/160] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:00 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:00.606174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:00.614538 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d32a4665-a513-45cf-993e-2ccfe6f07c2f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.348891 Jul 13 09:07:00.624019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 81/161] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:00 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:01.232322 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-1fb39aed-bcdd-40d4-8262-f0e821de3915 req-ede4a54e-e7b9-4b3c-a8d0-bf8a890841d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4652c89f-12a1-40ec-86aa-705cb63de65f", "name": "network-vif-plugged", "status": "completed", "tag": "23fec340-ea0c-4bbf-a12c-354b4909fa75"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:01.243803 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-1fb39aed-bcdd-40d4-8262-f0e821de3915 req-ede4a54e-e7b9-4b3c-a8d0-bf8a890841d1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:01.244549 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-1fb39aed-bcdd-40d4-8262-f0e821de3915 req-ede4a54e-e7b9-4b3c-a8d0-bf8a890841d1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:01.260111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-1fb39aed-bcdd-40d4-8262-f0e821de3915 req-ede4a54e-e7b9-4b3c-a8d0-bf8a890841d1 service nova] Creating event network-vif-plugged:23fec340-ea0c-4bbf-a12c-354b4909fa75 for instance 4652c89f-12a1-40ec-86aa-705cb63de65f on hv-cinder-84962 Jul 13 09:07:01.269173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-1fb39aed-bcdd-40d4-8262-f0e821de3915 req-ede4a54e-e7b9-4b3c-a8d0-bf8a890841d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039274 Jul 13 09:07:01.271948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 81/162] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:01.300915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:01.301825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:01.305804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:01.316848 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:01.317298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:01.318108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:01.318546 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:01.627477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:01.634378 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:01.635304 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:01.636405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-79925c77-7f3e-4005-97ce-7a2a976da7d1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.339304 Jul 13 09:07:01.637014 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 82/163] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:01 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:01.651193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:01.653784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:01.653784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:01.653784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:01.826363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:01.836424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8768c2e0-aa41-4cf3-a314-538da6bc6daa tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.207173 Jul 13 09:07:01.837725 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 82/164] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:01 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:01.963813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-cb5d752f-af90-4171-b499-c7d6530c8c89 req-a960dd5f-e124-49fb-b84b-a13c439d681e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:01.972321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-cb5d752f-af90-4171-b499-c7d6530c8c89 req-a960dd5f-e124-49fb-b84b-a13c439d681e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:01.972765 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-cb5d752f-af90-4171-b499-c7d6530c8c89 req-a960dd5f-e124-49fb-b84b-a13c439d681e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:01.986682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-cb5d752f-af90-4171-b499-c7d6530c8c89 req-a960dd5f-e124-49fb-b84b-a13c439d681e service nova] Creating event network-changed:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:07:01.992922 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-cb5d752f-af90-4171-b499-c7d6530c8c89 req-a960dd5f-e124-49fb-b84b-a13c439d681e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Jul 13 09:07:01.993811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 83/165] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:02.654645 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:02.655556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:02.666327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:02.666327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:02.666327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:02.666532 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:02.811763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:02.815552 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d5cb5ea0-cfe0-4571-9980-0571e71abb35 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.165466 Jul 13 09:07:02.816127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 83/166] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:02 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:02.855252 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:02.855953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:02.864120 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:02.864751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:02.865708 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:02.866175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:03.014710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:03.024330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a0ab9c57-86a8-4622-b80c-a1cc5f39872e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.173133 Jul 13 09:07:03.025023 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 84/167] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:02 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:03.833017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:03.833826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:03.840134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:03.840575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:03.841501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:03.841931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:04.021970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:04.029924 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4fee0352-bc81-4ca7-bf8f-22dd79602634 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.201081 Jul 13 09:07:04.030607 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 84/168] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:03 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:04.042050 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:04.042736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:04.049674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:04.050154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:04.050918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:04.051351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:04.197059 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:04.205119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-27ab9817-9260-48c5-9255-798fcc6b312a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.167248 Jul 13 09:07:04.205908 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 85/169] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:04 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:05.047034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:05.048216 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:05.054447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:05.054963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:05.056104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:05.056536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:05.215015 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:05.222683 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:05.223298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:05.223405 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a2e3d2e2-4e5d-405c-865f-a345e7dbf699 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.180074 Jul 13 09:07:05.224113 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 85/170] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:05 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:05.229347 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:05.229795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:05.230592 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:05.231028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:05.366362 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:05.373739 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-03c0aba9-37b4-441e-ad71-04ec7ff46fde tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.155215 Jul 13 09:07:05.374351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 86/171] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:05 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:06.239948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:06.240752 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:06.247111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:06.247580 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:06.248403 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:06.249038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:06.390913 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:06.392479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:06.395211 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:06.400884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:06.401514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:06.402615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:06.403192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:06.404313 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b228b574-2b77-4ef6-a8a0-266b57174786 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.167927 Jul 13 09:07:06.405346 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 86/172] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:06 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:06.541314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:06.549484 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-92a09802-870a-4942-9647-25af3719d5af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.162468 Jul 13 09:07:06.552317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 87/173] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:06 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:07.421376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:07.422665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:07.429060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:07.429502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:07.430322 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:07.430749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:07.565381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:07.566458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:07.567073 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:07.572941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4f2da2d7-56bd-46d3-80ee-c4d066ac62b4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1361 microversion: 2.1 time: 0.155480 Jul 13 09:07:07.573693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 87/174] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:07 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:07.573932 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:07.574753 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:07.575685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:07.576572 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:07.730264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:07.739790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-846005f1-7444-4138-b2fd-8d5d7f687e03 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.177125 Jul 13 09:07:07.740373 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 88/175] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:07 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:08.105486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0d97259-6fd8-4f7e-876a-ec631ba9167c"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:08.107639 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:08.114638 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.115290 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.116505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.117249 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.591113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:08.591779 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:08.607967 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.608405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.609243 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.613354 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.767682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:08.775201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1623b8b7-7dd7-4dae-80fe-250f3c2e558c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1547 microversion: 2.1 time: 0.188526 Jul 13 09:07:08.778169 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 89/176] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:08 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:08.780185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:08.780788 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:08.786696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.787146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.788155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.788609 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.948773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:08.957309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4c9e1d51-261e-45cb-b9b0-f66d94b22c42 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.180476 Jul 13 09:07:08.957926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 90/177] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:08 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:08.962438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:08.962926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:08.968881 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.975758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:08.975758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:08.975758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:09.076152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-753256c5-4ba7-43e9-b749-175600bc1265 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117122 Jul 13 09:07:09.077019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 91/178] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:07:08 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:09.820750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-867108c6-09a8-4c31-ba14-7d989a87b1b6 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "POST /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.719736 Jul 13 09:07:09.821397 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 88/179] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:07:08 2022] POST /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263/os-volume_attachments => generated 194 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:09.975080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:09.975704 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:09.981827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:09.982310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:09.983387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:09.983833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:10.387521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:10.404306 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d69f7bea-dac2-4fda-813e-97c6316f8f16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.433113 Jul 13 09:07:10.405403 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 92/180] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:09 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:10.486279 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-4517c9cc-f10e-4ee2-815b-5cb4b3ec65c5 req-c5c38b1c-4960-450d-829b-8269297b8125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4e5e88-6062-46c0-92b1-4f21fe81b697", "tag": "97786c99-fd64-4d30-a6bd-7dffa045cb11"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:10.495706 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-4517c9cc-f10e-4ee2-815b-5cb4b3ec65c5 req-c5c38b1c-4960-450d-829b-8269297b8125 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:10.506569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-4517c9cc-f10e-4ee2-815b-5cb4b3ec65c5 req-c5c38b1c-4960-450d-829b-8269297b8125 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:10.507872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-4517c9cc-f10e-4ee2-815b-5cb4b3ec65c5 req-c5c38b1c-4960-450d-829b-8269297b8125 service nova] Creating event network-changed:97786c99-fd64-4d30-a6bd-7dffa045cb11 for instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 on hv-cinder-84962 Jul 13 09:07:10.512847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-4517c9cc-f10e-4ee2-815b-5cb4b3ec65c5 req-c5c38b1c-4960-450d-829b-8269297b8125 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031492 Jul 13 09:07:10.516743 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 89/181] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:11.422167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:11.432140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:11.432140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:11.432140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:11.432674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:11.432842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:11.570006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:11.578567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5b7d2ef6-647a-4f85-b016-33174df20531 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.161101 Jul 13 09:07:11.579509 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 93/182] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:11 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:12.596612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:12.597510 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:12.604148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:12.604598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:12.605361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:12.605791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:12.749414 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:12.757989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5d3a5f43-b500-4edf-86a4-0026a8455532 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1322 microversion: 2.1 time: 0.165776 Jul 13 09:07:12.758703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 90/183] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:12 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:13.778441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:13.781164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:13.803394 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:13.806411 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:13.807902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:13.808722 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:13.987116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:14.007529 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-81473ea1-9633-4701-98a6-0c0c31db1c43 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1516 microversion: 2.1 time: 0.235271 Jul 13 09:07:14.008134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 94/184] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:13 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:14.025754 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:14.026796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:14.033507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=92 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:14.035982 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:14.036628 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:14.037407 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:14.037902 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:14.060503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'flavor' on Instance uuid 4652c89f-12a1-40ec-86aa-705cb63de65f {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:07:14.482841 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-17215680-8811-4eae-85e5-80a9c659a5b3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f/action" status: 200 len: 32 microversion: 2.1 time: 0.460990 Jul 13 09:07:14.483495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 91/185] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:07:14 2022] POST /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 09:07:14.492706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:14.493404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:14.499497 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:14.499941 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:14.500688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:14.501115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:14.520807 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:14.662874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:14.673043 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-dbd9af84-433f-44a8-a746-d14a8358d587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.183198 Jul 13 09:07:14.675486 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 95/186] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:14 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:15.695737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:15.696541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:15.714839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:15.715292 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:15.716128 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:15.716648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:15.876199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:15.883983 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-db886d02-ca5b-4aff-a771-aaf01d500568 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.193959 Jul 13 09:07:15.884804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 92/187] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:15 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:16.901819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:16.902501 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:16.912859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:16.913314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:16.914109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:16.914639 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:17.046992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:17.054517 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-924de846-3b18-4cc6-a35c-0466d33ed756 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.157078 Jul 13 09:07:17.055090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 96/188] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:16 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:18.071272 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:18.071878 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:18.078473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:18.078918 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:18.079671 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:18.080106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:18.220710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:18.229672 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3957adc5-7405-4561-9bec-68449e61bf37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.162104 Jul 13 09:07:18.230270 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 93/189] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:18 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:19.247422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:19.247998 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:19.254185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:19.254630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:19.255386 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:19.255818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:19.386802 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:19.395489 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e3693649-c117-4cce-93ca-af512f9d8414 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.152255 Jul 13 09:07:19.396056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 97/190] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:19 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:20.416460 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:20.417075 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:20.423728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:20.424199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:20.425608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:20.426132 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:20.568636 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:20.580174 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bbc879f9-9019-456e-9dd3-742f78d4523a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.163761 Jul 13 09:07:20.580174 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 94/191] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:20 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:21.594231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:21.596066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:21.602712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:21.603273 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:21.604218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:21.604658 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:21.751474 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:21.760040 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-86e5b6b7-936a-4dc7-9f55-a02b5f579a13 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.170881 Jul 13 09:07:21.760638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 98/192] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:21 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:22.302620 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:22.303161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:22.309610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:22.310089 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:22.311760 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:22.311760 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:22.316879 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:22.338541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:07:22.664203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-af89b012-ff83-4af4-a068-3a41a1831e21 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "DELETE /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 204 len: 0 microversion: 2.1 time: 0.365827 Jul 13 09:07:22.666592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 95/193] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:07:22 2022] DELETE /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:07:22.675249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:22.676419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:22.682561 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:22.683009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:22.683783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:22.684218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:22.782502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:22.783208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:22.790317 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:22.790996 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:22.791929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:22.792516 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:22.827675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:22.836827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b483fbcc-6b65-4b7e-86c8-ba956ab8dc90 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1553 microversion: 2.1 time: 0.166071 Jul 13 09:07:22.837405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 99/194] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:22 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:22.939756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:22.947772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-59170465-91c6-4d17-b289-6581fc16667c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.169762 Jul 13 09:07:22.948337 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 96/195] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:22 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:23.853681 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:23.854319 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:23.860276 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:23.860721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:23.861474 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:23.861900 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:23.966748 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:23.967963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:23.978836 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:23.979488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:23.981242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:23.981839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:24.019155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:24.035033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a455e766-8a8d-444d-a771-cda79ab5b9bf tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1553 microversion: 2.1 time: 0.178002 Jul 13 09:07:24.037194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 100/196] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:23 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:24.147494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:24.156854 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a85741c3-7047-44f9-b794-c1a01e5f5744 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.195624 Jul 13 09:07:24.157653 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 97/197] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:23 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:25.054956 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:25.055935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:25.064927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:25.065806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:25.067900 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:25.068770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:25.178535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:25.179166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:25.188308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:25.188828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:25.189522 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:25.194673 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:25.279822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:25.290018 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-81edac15-5632-4d38-84ac-2a029bd8e719 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1553 microversion: 2.1 time: 0.240323 Jul 13 09:07:25.290969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 101/198] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:25 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:25.507548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:25.515653 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cdb7a930-2905-4bd9-bb96-3487abfd7adb tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.342035 Jul 13 09:07:25.517273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 98/199] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:25 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:25.804544 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-59a0d181-8150-4833-b4d2-f6cb30f3f3ff req-b172a84a-9906-412f-8c20-640f0318392e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503d3aeb-a476-4caf-afa3-c4311d6ac263", "name": "network-vif-deleted", "tag": "69be1990-5762-4324-89fe-b1139a371704"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:25.824565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-59a0d181-8150-4833-b4d2-f6cb30f3f3ff req-b172a84a-9906-412f-8c20-640f0318392e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:25.824565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-59a0d181-8150-4833-b4d2-f6cb30f3f3ff req-b172a84a-9906-412f-8c20-640f0318392e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:25.836494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-59a0d181-8150-4833-b4d2-f6cb30f3f3ff req-b172a84a-9906-412f-8c20-640f0318392e service nova] Creating event network-vif-deleted:69be1990-5762-4324-89fe-b1139a371704 for instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 on hv-cinder-84962 Jul 13 09:07:25.846916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-59a0d181-8150-4833-b4d2-f6cb30f3f3ff req-b172a84a-9906-412f-8c20-640f0318392e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046287 Jul 13 09:07:25.847886 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 102/200] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:26.307901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:26.308520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:26.315031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:26.315584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:26.316678 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:26.317271 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:26.400966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6eb40fbef34931b668330b9f4db27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461a578ac4d44ffc9284d56a09d6c18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:26.404887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e61901ce-2c3e-4b45-841a-eee555223fe4 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 200 len: 1345 microversion: 2.1 time: 0.101345 Jul 13 09:07:26.405987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 99/201] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:26 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:26.534737 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:26.535434 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:26.541688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:26.542156 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:26.542916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:26.543341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:26.683567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:26.692287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-681e278e-a1e0-4d2d-b8ef-313a5327698d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.161942 Jul 13 09:07:26.693680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 103/202] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:26 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:27.427620 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:27.428285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:27.435670 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:27.436350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:27.437118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:27.437549 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:27.453637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] HTTP exception thrown: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Request method failure captured: Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 HTTP/1.1 Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosGKu3RJc49uI_Srt2fqlL-Kj9gETx8fUhRB_3fiFM-6Cjk4IeHtZOoJN98FZLLqUSThISnGwcb72RE98QznQ1BKYXxP0cnvzSkCENIkq0i62gfsjlsl4zb6LxVgz1j_JD5D3g5_RcVYYfmqU_PbwP8d7K9QZ2GX92qqgE6gmOu0x4 Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:07:27.458934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 9f6eb40fbef34931b668330b9f4db27d Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.470410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '503d3aeb-a476-4caf-afa3-c4311d6ac263'} Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:07:27.471310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.472439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.473395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Returning 404 to user: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:07:27.473395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-016497db-9247-4a69-ad4b-7f7237647b68 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 404 len: 111 microversion: 2.1 time: 0.039288 Jul 13 09:07:27.473395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 100/203] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:27 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:07:27.583187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:27.583187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:27.588636 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:27.589296 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:27.590081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:27.590681 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:27.604061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] HTTP exception thrown: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Request method failure captured: Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263/os-volume_attachments HTTP/1.1 Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosGKu3RJc49uI_Srt2fqlL-Kj9gETx8fUhRB_3fiFM-6Cjk4IeHtZOoJN98FZLLqUSThISnGwcb72RE98QznQ1BKYXxP0cnvzSkCENIkq0i62gfsjlsl4zb6LxVgz1j_JD5D3g5_RcVYYfmqU_PbwP8d7K9QZ2GX92qqgE6gmOu0x4 Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:07:27.608236 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 9f6eb40fbef34931b668330b9f4db27d Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.612878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'server_id': '503d3aeb-a476-4caf-afa3-c4311d6ac263'} Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:07:27.613940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:27.615542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:27.617408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Returning 404 to user: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:07:27.617408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fff5d7b0-1f3a-4f9a-bb12-e0a5e5710250 tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032734 Jul 13 09:07:27.617408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 104/204] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:07:27 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:07:27.709953 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:27.712699 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:27.717316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:27.718387 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:27.719387 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:27.719971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:28.079223 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:28.104418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b24768cb-e390-46c8-9066-f517c855032b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.395375 Jul 13 09:07:28.106195 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 101/205] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:27 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:29.028886 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:29.029430 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:29.043097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:29.043793 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:29.044731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:29.045164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:29.060699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] HTTP exception thrown: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Request method failure captured: Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: DELETE /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 HTTP/1.1 Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosGKu3RJc49uI_Srt2fqlL-Kj9gETx8fUhRB_3fiFM-6Cjk4IeHtZOoJN98FZLLqUSThISnGwcb72RE98QznQ1BKYXxP0cnvzSkCENIkq0i62gfsjlsl4zb6LxVgz1j_JD5D3g5_RcVYYfmqU_PbwP8d7K9QZ2GX92qqgE6gmOu0x4 Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:07:29.062947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 9f6eb40fbef34931b668330b9f4db27d Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.065330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '503d3aeb-a476-4caf-afa3-c4311d6ac263'} Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:07:29.067067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.068980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.071218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Returning 404 to user: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:07:29.071218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0840879e-e794-4de1-ba0f-e1b27eaef9ea tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "DELETE /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 404 len: 111 microversion: 2.1 time: 0.040611 Jul 13 09:07:29.071218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 105/206] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:07:29 2022] DELETE /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:07:29.075124 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:29.075683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] [instance: 503d3aeb-a476-4caf-afa3-c4311d6ac263] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:29.082348 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:29.086413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:29.086413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:29.086413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:29.105210 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] HTTP exception thrown: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Request method failure captured: Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 HTTP/1.1 Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosGKu3RJc49uI_Srt2fqlL-Kj9gETx8fUhRB_3fiFM-6Cjk4IeHtZOoJN98FZLLqUSThISnGwcb72RE98QznQ1BKYXxP0cnvzSkCENIkq0i62gfsjlsl4zb6LxVgz1j_JD5D3g5_RcVYYfmqU_PbwP8d7K9QZ2GX92qqgE6gmOu0x4 Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:07:29.106786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461a578ac4d44ffc9284d56a09d6c18e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 461a578ac4d44ffc9284d56a09d6c18e Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-DeleteServersTestJSON-817453827 Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 9f6eb40fbef34931b668330b9f4db27d Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-DeleteServersTestJSON-817453827-project Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.107952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '503d3aeb-a476-4caf-afa3-c4311d6ac263'} Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:07:29.108627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. Jul 13 09:07:29.109929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:07:29.111268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] Returning 404 to user: Instance 503d3aeb-a476-4caf-afa3-c4311d6ac263 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:07:29.111268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c18d91f4-7a2d-4692-84bf-fe65cb9a04ec tempest-DeleteServersTestJSON-817453827 tempest-DeleteServersTestJSON-817453827-project] 10.222.0.40 "GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263" status: 404 len: 111 microversion: 2.1 time: 0.038272 Jul 13 09:07:29.113591 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 102/207] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:29 2022] GET /compute/v2.1/servers/503d3aeb-a476-4caf-afa3-c4311d6ac263 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:07:29.126211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:29.126211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:29.137658 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:29.138777 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:29.140905 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:29.142448 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:29.434577 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:29.450716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4b6788d7-b464-417f-b8f5-ed143994a237 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.332708 Jul 13 09:07:29.453384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 106/208] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:29 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:30.479325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:30.480148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:30.489230 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:30.489909 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:30.491735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:30.492331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:30.706479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:30.720267 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ee89e0cb-932e-4c1b-86d3-6dbd783fc979 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.245468 Jul 13 09:07:30.721795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 103/209] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:30 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:31.739254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:31.740446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:31.747327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:31.748042 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:31.749870 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:31.750505 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:31.999740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:32.009004 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2d2a6e3a-a6b3-4319-9dd5-e74d0c4cfb66 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.275611 Jul 13 09:07:32.009749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 107/210] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:31 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:33.027369 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:33.027985 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:33.035690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:33.036323 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:33.037091 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:33.037549 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:33.200417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:33.208443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-42ece8cf-c17e-441f-80ad-937c050ac5c8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.184813 Jul 13 09:07:33.209040 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 104/211] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:33 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:34.225625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:34.226183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:34.228675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=52 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:34.233670 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:34.234384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:34.235351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:34.235986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:34.431948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:34.440174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a2c9cdc0-2773-40dd-8738-c08c30e1f797 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.218609 Jul 13 09:07:34.440811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 108/212] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:34 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:35.457203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:35.459154 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:35.466742 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:35.467196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:35.468255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:35.468677 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:35.667795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:35.679325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cf5f0266-f821-4055-b6d4-cce83e78bd39 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.224288 Jul 13 09:07:35.679325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 105/213] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:35 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:36.551797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ba3eeb71-7be3-46fb-9f5c-689468085a40 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Action: 'create', calling method: .version_select at 0x7fad21c71550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2092275654", "metadata": {"Type": "work"}}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:07:36.695882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:36.697248 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:36.704400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:36.704789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:36.705933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:36.706232 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:36.844447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:36.853086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b155fb20-975c-474f-9bb2-f88efadf664f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.161784 Jul 13 09:07:36.853800 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 106/214] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:36 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:07:37.240729 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ba3eeb71-7be3-46fb-9f5c-689468085a40 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.959985 Jul 13 09:07:37.241396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 109/215] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Jul 13 09:07:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 961 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 13 09:07:37.253275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-252867c5-65ec-440f-9fd2-4519ea66a536 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Calling method '.version_select at 0x7fad22475550>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:37.318592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-252867c5-65ec-440f-9fd2-4519ea66a536 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a" status: 200 len: 353 microversion: 2.1 time: 0.069833 Jul 13 09:07:37.319165 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 107/216] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:07:37 2022] GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:37.871139 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:37.871774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:37.878881 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:37.879393 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:37.880247 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:37.880746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:38.012685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:38.022095 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1e08d60f-c0e0-4663-b8d9-6497986bf22f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.154618 Jul 13 09:07:38.022930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 110/217] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:37 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:38.331533 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cf8a932a-148c-461a-b18e-b583b67159c8 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Calling method '.version_select at 0x7fad2224a430>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:38.381380 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cf8a932a-148c-461a-b18e-b583b67159c8 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a" status: 200 len: 354 microversion: 2.1 time: 0.054409 Jul 13 09:07:38.381983 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 108/218] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:07:38 2022] GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:38.395115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e2972f62-4053-43f7-9019-db93f91a5f97 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Calling method '.version_select at 0x7fad21c980d0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:38.446956 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e2972f62-4053-43f7-9019-db93f91a5f97 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a" status: 200 len: 354 microversion: 2.1 time: 0.057707 Jul 13 09:07:38.447713 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 111/219] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:07:38 2022] GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:07:38.466298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b2e4c39d-d7b0-4966-8c1c-2f807c2a7087 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Calling method '.version_select at 0x7fad22420c10>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:38.718660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b2e4c39d-d7b0-4966-8c1c-2f807c2a7087 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a" status: 202 len: 0 microversion: 2.1 time: 0.254080 Jul 13 09:07:38.718660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 109/220] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:07:38 2022] DELETE /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:07:38.727237 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a2df4ccc-8c2a-4107-b992-a61522095a02 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Calling method '.version_select at 0x7fad21afd9d0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:38.796049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a2df4ccc-8c2a-4107-b992-a61522095a02 tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a" status: 200 len: 353 microversion: 2.1 time: 0.074548 Jul 13 09:07:38.796665 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 112/221] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:07:38 2022] GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:07:39.039501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:39.040220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:39.046331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:39.046782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:39.047541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:39.047976 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:39.199802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:39.208053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d8e67e39-178e-4834-980a-73714a71f1e5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.172360 Jul 13 09:07:39.208630 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 110/222] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:39 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:39.813986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d7fc2477-b6a2-4b8a-9995-6bf02ab51a8b tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Calling method '.version_select at 0x7fad21b074c0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:39.844491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-d7fc2477-b6a2-4b8a-9995-6bf02ab51a8b tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] HTTP exception thrown: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d7fc2477-b6a2-4b8a-9995-6bf02ab51a8b tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Request method failure captured: Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a HTTP/1.1 Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizotYjWFIrZkAAk3OyWFjU01QAHd3TQTKUOMWtxSX1mZeMNghfc04oH6JgocT3KmspBOQeK1-Vi1lcqL475iBUV4wATRVk6oHmJ42bA4236CJsckSaaZi8QQ7YAjdQmoRZcWhUFM-BCBlySIVcnVYpu6VVyy9FGtoBEgZa9WMDUqOljw Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 119065e59b3a424792e33a9e9ce102e4 Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesGetTestJSON-1587073562 Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:07:39.847893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/119065e59b3a424792e33a9e9ce102e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_119065e59b3a424792e33a9e9ce102e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/119065e59b3a424792e33a9e9ce102e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/119065e59b3a424792e33a9e9ce102e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesGetTestJSON-1587073562 Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 119065e59b3a424792e33a9e9ce102e4 Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesGetTestJSON-1587073562 Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesGetTestJSON-1587073562-project Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 46b1196a54094ff49ee8afabb758281c Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesGetTestJSON-1587073562-project Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a'} Jul 13 09:07:39.849234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. (HTTP 404) (Request-ID: req-17b92a2b-90b8-4ca9-9801-b26c6a1570a6) Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:39.849952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 13 09:07:39.851080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 13 09:07:39.852106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d7fc2477-b6a2-4b8a-9995-6bf02ab51a8b tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] Returning 404 to user: Volume 4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d7fc2477-b6a2-4b8a-9995-6bf02ab51a8b tempest-VolumesGetTestJSON-1587073562 tempest-VolumesGetTestJSON-1587073562-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a" status: 404 len: 109 microversion: 2.1 time: 0.044157 Jul 13 09:07:39.853113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 113/223] 10.222.0.40 () {58 vars in 1244 bytes} [Wed Jul 13 09:07:39 2022] GET /compute/v2.1/os-volumes/4ce9bebc-d3bd-4b04-b6a3-7d635fb0554a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:07:40.224749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:40.225423 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:40.232084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:40.232586 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:40.233355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:40.233789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:40.369482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:40.398433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bf81fff6-7419-42d2-b6cd-4814419841d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.177468 Jul 13 09:07:40.399052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 111/224] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:40 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:41.416344 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:41.417476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:41.423790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:41.424315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:41.425889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:41.426431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:41.583783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:41.591588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-247fc517-b2ed-4fdf-bd28-c3d64e4c9a1c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.179132 Jul 13 09:07:41.592508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 114/225] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:41 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:42.608515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:42.609122 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:42.616094 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:42.616570 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:42.617308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:42.617735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:42.754891 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:42.763136 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d7076c62-f544-444b-8dc5-677388d4a162 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.158314 Jul 13 09:07:42.764013 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 112/226] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:42 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:43.780566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:43.781169 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:43.787628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:43.788069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:43.788825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:43.789287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:43.938876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:43.954350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9def9e52-96c4-4a5b-b78c-ebf42def4381 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.177413 Jul 13 09:07:43.955324 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 115/227] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:43 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:44.973815 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:44.974451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:44.977011 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:44.981683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:44.982255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:44.983012 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:44.983439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:45.124244 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:45.137441 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2dd33aea-8731-4b02-a068-8693b607db96 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.162706 Jul 13 09:07:45.137441 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 113/228] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:44 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:46.153997 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:46.154629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:46.161303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:46.161747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:46.162546 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:46.162989 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:46.303219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:46.310700 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e0c5eabf-69c9-4758-9ace-49b3228f90db tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.160611 Jul 13 09:07:46.311331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 116/229] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:46 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:47.327931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:47.328557 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:47.337061 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:47.337507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:47.338300 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:47.338793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:47.365741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:47.506970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:47.515728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-961f8cb0-154c-41c4-b561-827b22f320b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.191854 Jul 13 09:07:47.516748 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 114/230] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:47 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:48.535552 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:48.536408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:48.546237 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:48.546688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:48.548115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:48.548558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:48.562169 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=93 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:48.803316 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:48.811977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-86a95cec-7312-43d6-8e33-7a1a046a926a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.281572 Jul 13 09:07:48.813105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 117/231] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:48 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:49.830155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:49.830995 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:49.838809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:49.839378 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:49.840415 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:49.840944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:49.984649 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:49.992683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-895b6ff4-7001-4973-a57b-b25a7c1f63c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.166597 Jul 13 09:07:49.993281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 115/232] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:49 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:51.010003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:51.010641 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:51.017384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:51.017719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:51.019352 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:51.020192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:51.232944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:51.242353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-321786cf-51fa-4c69-bc74-e573773794a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.236423 Jul 13 09:07:51.243258 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 118/233] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:51 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:52.264867 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:52.266543 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:52.287798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:52.289886 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:52.294847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:52.295585 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:52.484789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:52.494667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f5c609a0-3c52-46f6-915f-076198f8f1c0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.238465 Jul 13 09:07:52.495256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 116/234] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:52 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:53.512859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:53.513616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:53.527153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:53.527961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:53.528795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:53.531757 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:53.698262 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:53.708259 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3640c67f-11c6-406e-888a-504db2d86dc6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.199776 Jul 13 09:07:53.717751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 119/235] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:53 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:54.726390 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:54.728327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:54.739352 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:54.742186 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:54.743566 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:54.750478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:54.994587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:55.002708 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-716542d4-1f67-4e20-bcd4-ace875d48c1f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.281402 Jul 13 09:07:55.008705 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 117/236] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:54 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:56.020918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:56.021521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:56.032861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:56.033543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:56.034566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:56.035188 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:56.273874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:56.282452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-858ad07c-a13f-4484-96f9-fbd72c9aaac2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.265808 Jul 13 09:07:56.286257 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 120/237] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:56 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:57.198158 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:57.199436 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:57.208380 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:57.208831 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:57.209643 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:57.210109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:57.243268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d9c3807a-408a-4935-b402-52e7c11abc23 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/ips" status: 200 len: 152 microversion: 2.20 time: 0.048995 Jul 13 09:07:57.251740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 118/238] 10.222.0.40 () {60 vars in 1288 bytes} [Wed Jul 13 09:07:57 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:07:57.304447 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:57.305293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:57.312814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:57.313272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:57.314078 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:57.314779 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:57.589723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:57.600464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d77a48f7-ea20-4062-9a90-d144f4a883b5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.298730 Jul 13 09:07:57.601267 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 121/239] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:57 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:07:58.617506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:07:58.618668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:07:58.625558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:58.625997 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:58.626782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:07:58.627923 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:07:59.191001 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:07:59.204806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a75eb4b5-52a1-47f1-a4cb-4c404b133765 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1522 microversion: 2.1 time: 0.591280 Jul 13 09:07:59.207898 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 119/240] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:07:58 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:00.223825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:00.224980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:00.231583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:00.232076 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:00.233005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:00.233628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:00.350299 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:00.350853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:00.375224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:00.375224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:00.375224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:00.375224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:00.407104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lazy-loading 'flavor' on Instance uuid f7bcc760-4b60-4bfc-bd63-33c070d886b6 {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:08:00.465957 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:00.476930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f7f95810-8c7c-4e5e-8438-4f59e890e9b9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1502 microversion: 2.1 time: 0.255108 Jul 13 09:08:00.478451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 122/241] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:00 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:00.498159 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:00.499234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:00.509930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:00.510795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:00.512781 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:00.513623 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:00.696368 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:00.711125 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2adf6970-565e-461e-97c8-b3cf61a3ce3c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1515 microversion: 2.1 time: 0.218440 Jul 13 09:08:00.712366 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 123/242] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:00 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:02.954352 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:02.960238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:02.973588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:02.974092 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:02.974884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:02.975297 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:03.012559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'flavor' on Instance uuid 8315445c-678d-4c5c-8ecf-937e48a120a4 {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:08:03.419791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8b664e93-462b-463e-9267-e58f434a6788 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/action" status: 200 len: 32 microversion: 2.1 time: 0.473325 Jul 13 09:08:03.420428 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 124/243] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:08:02 2022] POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/action => generated 32 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:08:03.430934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:03.432188 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:03.447752 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:03.449061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:03.450178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:03.452984 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:03.924102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:03.936309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-37a2c58a-1f4d-4f9a-85a5-7a01a3aba4e7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.507199 Jul 13 09:08:03.936309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 125/244] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:03 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:04.952828 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:04.956545 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:04.964854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=28 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:04.968492 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:04.971116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:04.973473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:04.975113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:05.312419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:05.329097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a6bc3458-df89-472a-9ad2-686868b13120 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.380568 Jul 13 09:08:05.330196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 126/245] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:04 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:05.853268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:05.853268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:05.857682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:05.858168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:05.858955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:05.859388 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:05.907828 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4a9e4ddc-a74c-4ee7-81ae-167c380ddf19 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/ips" status: 200 len: 146 microversion: 2.1 time: 0.061184 Jul 13 09:08:05.918951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 127/246] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:08:05 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/ips => generated 146 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:08:06.353598 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:06.354279 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:06.364940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:06.364940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:06.364940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:06.364940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:06.553375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:06.575555 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4ed84634-c98e-4b3d-a0d1-8f4dcb5c8315 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.225964 Jul 13 09:08:06.576771 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 128/247] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:06 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:07.601047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:07.601899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:07.609364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:07.609874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:07.610731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:07.611370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:07.853422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:07.881223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0b1e01e6-36b3-47a0-9f90-14a3f28263ae tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.288543 Jul 13 09:08:07.906140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 129/248] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:07 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:08.901766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:08.903205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:08.911247 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:08.912081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:08.913033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:08.913738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:09.068025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:09.085254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3236b9cb-6a1f-4d7b-af49-80e5133bc593 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.189794 Jul 13 09:08:09.090491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 130/249] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:08 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:09.613173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3b210336-5aab-4f9a-abcc-490fd64168a7 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/action" status: 202 len: 0 microversion: 2.20 time: 9.274902 Jul 13 09:08:09.616139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 120/250] 10.222.0.40 () {62 vars in 1318 bytes} [Wed Jul 13 09:08:00 2022] POST /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/action => generated 0 bytes in 9279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:08:09.627794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:09.631827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:09.648839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:09.649697 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:09.651730 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:09.653217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:09.823991 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "852af400-b239-4e51-a452-994aac67e783"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:09.825142 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:09.842883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:09.843335 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:09.844118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:09.844597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:09.925911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:09.934825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:09.937780 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:09.939089 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-10c5bfbb-195e-49ea-aef7-0ccd4370d660 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.318171 Jul 13 09:08:09.952065 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 131/251] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:09 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:10.103239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:10.104574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:10.113683 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:10.132625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:10.133499 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:10.137272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:10.162101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:10.593384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:10.593384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d2581ce3-bc3f-4900-8364-ad587f597858 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.380558 Jul 13 09:08:10.593384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 132/252] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:10 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:10.958674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:10.959407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:10.965256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:10.965731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:10.966530 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:10.966961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:11.112780 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:11.120565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:11.122104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:11.123252 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-684a0af1-343f-4028-b64b-2ba20be915b3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.169124 Jul 13 09:08:11.123811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 133/253] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:10 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:11.606847 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:11.607977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:11.620696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:11.621144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:11.621926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:11.622396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:11.688483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e84d3895-b037-4172-a1ef-4565052e3f1a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.869921 Jul 13 09:08:11.690501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 121/254] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:08:09 2022] POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-volume_attachments => generated 194 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:11.831186 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:11.848365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-55eef4ec-a38d-44d9-a5f0-9dacf124cfa6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.244288 Jul 13 09:08:11.850381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 134/255] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:11 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:12.142977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:12.143949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:12.155796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:12.156342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:12.157216 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:12.158590 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:12.367312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:12.377737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:12.379301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:12.380486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2f34756e-1225-4db8-a4df-8a99bef2d5ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.242332 Jul 13 09:08:12.392177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 122/256] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:12 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:12.875716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:12.876363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:12.884661 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:12.885111 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:12.885889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:12.886355 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:13.085950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:13.093872 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b88921d4-5c35-4131-aba6-baa48554ff24 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.222623 Jul 13 09:08:13.095141 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 135/257] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:12 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:13.398803 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:13.399498 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:13.406564 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:13.407324 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:13.408842 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:13.409366 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:13.612118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:13.621981 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:13.623750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:13.624972 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9204a651-a6e8-4343-887f-f31d1b85206b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.230053 Jul 13 09:08:13.625889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 123/258] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:13 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:14.112854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:14.115882 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:14.125040 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:14.125768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:14.127434 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:14.128030 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:14.301460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:14.311350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2ccb5573-fc17-4e2d-b9fa-8ceeea9463a7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.203756 Jul 13 09:08:14.314818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 136/259] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:14 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:14.649376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:14.650253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:14.677156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:14.677156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:14.677156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:14.677156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:14.845686 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:14.862975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:14.864495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:14.866275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e517d333-39d0-49db-aba7-27711a6761ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.222168 Jul 13 09:08:14.868216 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 124/260] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:14 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:15.331267 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:15.331881 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:15.338357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:15.339170 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:15.340162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:15.340747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:15.491566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:15.502675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9b6fad2c-d4dc-47f8-ad60-780d18e2a270 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.173909 Jul 13 09:08:15.503186 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 137/261] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:15 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:15.884535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:15.885144 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:15.892419 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:15.892865 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:15.893629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:15.894098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:16.060486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:16.071953 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:16.075989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:16.077733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1497a27b-1a9e-4c6e-abf8-487bb5b8ad3e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.197046 Jul 13 09:08:16.078351 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 125/262] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:15 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:16.268934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d89ad5bf-77d5-48b1-b0cf-3147d7ec61c8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Action: 'create', calling method: .version_select at 0x7fad21ae8430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1693585511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWVzL2BuSzgd/v1/1Rs6InXvfrUvkS8Nlm6/OS8h9mnNLS0xtuS9nk78aWQ6A7TULvk7PmhgUh56OFz/Lfx3jMpFNS4LMq2bxhYFxo88JQvHbuWSHHkkPea9DvoEYMcAg=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:16.283048 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-d89ad5bf-77d5-48b1-b0cf-3147d7ec61c8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Getting quotas for project be3ff54edaf7439bab9ca81656e94c70. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:08:16.286795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-d89ad5bf-77d5-48b1-b0cf-3147d7ec61c8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Getting quotas for user 1ac8c3e3e99e412bb4a1f7b1506abce2 and project be3ff54edaf7439bab9ca81656e94c70. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:08:16.363959 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d89ad5bf-77d5-48b1-b0cf-3147d7ec61c8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.099089 Jul 13 09:08:16.364561 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 138/263] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:08:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:16.462665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-773022631", "imageRef": "33f842a6-3c39-440f-9a26-13eba7ade22a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1693585511", "networks": [{"uuid": "913797b9-97f0-4f1d-84dd-b458a159148c"}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:16.514318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] validate_networks() for [('913797b9-97f0-4f1d-84dd-b458a159148c', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:08:16.519726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:16.520370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:16.526746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:16.528852 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:16.528852 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:16.528852 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:16.707957 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:16.715738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8a594066-4da1-47d8-aa3e-2bc158ebbbb0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.199843 Jul 13 09:08:16.716317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 139/264] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:16 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:16.902433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:08:16.902914 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:08:16.903351 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:08:16.903763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:08:16.904170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:08:17.051462 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:17.051907 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:17.052709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:17.053143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:17.070441 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Getting quotas for project be3ff54edaf7439bab9ca81656e94c70. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:08:17.074935 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Getting quotas for user 1ac8c3e3e99e412bb4a1f7b1506abce2 and project be3ff54edaf7439bab9ca81656e94c70. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:08:17.089533 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:08:17.091903 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33f842a6-3c39-440f-9a26-13eba7ade22a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:08:17.100327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:17.101581 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:17.113903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:17.114402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:17.118599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:17.118599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:17.238630 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f2bcb6f2-f303-4edb-8d5d-01a517667ef8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779825 Jul 13 09:08:17.239463 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 126/265] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:08:17.249102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:17.253581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d67192c3-aa6f-451e-90a0-7fdd85257a5a tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:17.256163 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d67192c3-aa6f-451e-90a0-7fdd85257a5a tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:17.259806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:17.261331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:17.262891 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3d6e4cbf-9f96-4fa4-a64a-53827fe76244 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.169650 Jul 13 09:08:17.264069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 140/266] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:17 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:17.311227 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d67192c3-aa6f-451e-90a0-7fdd85257a5a tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:17.318808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d67192c3-aa6f-451e-90a0-7fdd85257a5a tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1258 microversion: 2.1 time: 0.073368 Jul 13 09:08:17.319357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 127/267] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:17 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:17.732951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:17.733556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:17.740780 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:17.741223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:17.742213 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:17.742606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:17.873311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:17.882341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6ab24adc-ddcd-4d08-a38a-32b41cf66684 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.153313 Jul 13 09:08:17.882833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 141/268] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:17 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:18.282150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:18.283486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:18.285836 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:18.290657 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:18.291137 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:18.291889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:18.292360 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:18.337019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:18.337587 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:18.351501 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:18.357122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:18.357122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:18.357122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:18.418127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:18.426609 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-eb4cccc4-ab3c-4fff-958d-8ec986862435 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1262 microversion: 2.1 time: 0.093528 Jul 13 09:08:18.427418 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 142/269] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:18 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:18.433364 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:18.441849 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:18.443409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:18.444667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3f6bf725-08d8-45d1-9130-23103089bf7f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.166519 Jul 13 09:08:18.445224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 128/270] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:18 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:18.899694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:18.900300 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:18.906611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:18.910797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:18.910797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:18.910797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:19.042550 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:19.050820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-21aeb232-c8a2-4088-991b-aa167be923af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.155025 Jul 13 09:08:19.051390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 143/271] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:18 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:19.443505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:19.444118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:19.450417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:19.450863 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:19.451672 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:19.452108 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:19.463445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:19.464056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:19.470856 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:19.471387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:19.472154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:19.472596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:19.523164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:19.531252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:19.534348 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c0c59c37-9c93-411f-a2c2-cfea8f748780 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1310 microversion: 2.1 time: 0.095006 Jul 13 09:08:19.539241 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 129/272] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:19 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:19.603787 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:19.612450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:19.614005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:19.615190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-39e511fb-c4b1-419e-b25d-23bf0f759191 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.155710 Jul 13 09:08:19.615736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 144/273] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:19 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:20.068440 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:20.069318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:20.087343 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:20.096756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:20.097995 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:20.099319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:20.248370 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:20.256581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8db0d865-faa1-4291-81b4-1d9cb0b1785a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.192069 Jul 13 09:08:20.257289 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 130/274] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:20 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:20.552107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:20.552771 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:20.558874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:20.559126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:20.559893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:20.560321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:20.628766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:20.634203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:20.634950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:20.637336 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-76719a8e-85b2-4e1f-aa64-d7a29e155b42 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1316 microversion: 2.1 time: 0.089860 Jul 13 09:08:20.638915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 145/275] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:20 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:20.647109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:20.648017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:20.648779 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:20.649222 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:20.849139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:20.857810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:20.859350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:20.860810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f2b49b46-da53-4fcf-ae5d-8e5c68995f6c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.230562 Jul 13 09:08:20.861535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 131/276] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:20 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:21.273749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:21.274395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:21.280817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:21.281272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:21.282175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:21.282650 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:21.654594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:21.655347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:21.661514 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:21.663156 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-24808cf1-f3b3-4c59-a5df-3bc7ef04511d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.393517 Jul 13 09:08:21.663291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:21.663722 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 146/277] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:21 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:21.663940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:21.664488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:21.664920 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:21.809266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:21.817170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-90b70e55-d1ca-453d-9575-7ea578ebdfbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.165866 Jul 13 09:08:21.821945 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 132/278] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:21 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:21.878981 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:21.879700 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:21.885524 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:21.885966 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:21.890899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:21.890899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:22.023403 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:22.032999 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:22.034842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:22.036049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1aa67ed0-4c2b-4fae-8ad6-9a161af7ea3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.160959 Jul 13 09:08:22.036621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 147/279] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:21 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:22.679952 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:22.680558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:22.687684 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:22.688126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:22.689383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:22.689818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:22.822507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:22.830365 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0fb8067e-e8ca-495a-b5e5-46f685b62815 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.154167 Jul 13 09:08:22.831062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 133/280] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:22 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:22.834166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:22.836468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:22.841190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:22.841632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:22.842417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:22.842842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:22.973731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:22.981058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7d4048b7-4d2e-4f1b-aadf-55cbaa6ca229 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.150748 Jul 13 09:08:22.981622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 148/281] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:22 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:23.054274 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:23.054809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:23.060722 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.061157 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:23.061905 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.062363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:23.187532 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:23.197506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:23.199438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:23.200614 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b5eb0dbb-e277-42a2-8d28-8d67f1f36e9e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.150289 Jul 13 09:08:23.210109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 134/282] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:23 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:23.548295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b4c570b3-e200-4aa4-8152-584bcc0149be tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:23.557578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b4c570b3-e200-4aa4-8152-584bcc0149be tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.557969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b4c570b3-e200-4aa4-8152-584bcc0149be tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:23.620945 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b4c570b3-e200-4aa4-8152-584bcc0149be tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Going to try to stop instance {{(pid=118252) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 13 09:08:23.625317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:23.777916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b4c570b3-e200-4aa4-8152-584bcc0149be tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action" status: 202 len: 0 microversion: 2.1 time: 0.234432 Jul 13 09:08:23.778905 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 149/283] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:08:23 2022] POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:08:23.789587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:23.790839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:23.807256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.808245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:23.809264 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.809933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:23.848801 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:23.849616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:23.867180 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.867621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:23.868434 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:23.869079 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:24.153381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:24.166057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-60cea6ef-f51e-4bd4-830b-b874854ea342 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.322102 Jul 13 09:08:24.166673 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 150/284] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:23 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:24.187903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:24.187903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:24.201638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:24.202104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:24.213118 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:24.214611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:24.386835 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:24.396148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f2376742-639b-41b5-9f84-59d5dd5166b2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.611008 Jul 13 09:08:24.404806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 135/285] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:23 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:24.410251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:24.414537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:24.425598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:24.426148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:24.427166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:24.439746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:24.454344 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:24.466540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1637992f-3a96-45ad-97ff-72b2097d25e3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.286285 Jul 13 09:08:24.471977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 151/286] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:24 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:24.640162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:24.652424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:24.654507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:24.656247 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7e08641e-24f4-4e7f-bc4d-f76e0f5eecff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.250257 Jul 13 09:08:24.657857 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 136/287] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:24 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:24.739491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-317a37ca-0260-4314-8263-4e7c550869b3 req-8a9dff22-9508-46cb-85bd-f820d69b1797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:24.763521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-317a37ca-0260-4314-8263-4e7c550869b3 req-8a9dff22-9508-46cb-85bd-f820d69b1797 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:24.764379 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-317a37ca-0260-4314-8263-4e7c550869b3 req-8a9dff22-9508-46cb-85bd-f820d69b1797 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:24.801309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-317a37ca-0260-4314-8263-4e7c550869b3 req-8a9dff22-9508-46cb-85bd-f820d69b1797 service nova] Creating event network-changed:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:08:24.811770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-317a37ca-0260-4314-8263-4e7c550869b3 req-8a9dff22-9508-46cb-85bd-f820d69b1797 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080143 Jul 13 09:08:24.812535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 152/288] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:08:25.183658 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:25.184333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:25.194264 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.194972 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.195950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.196556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.423203 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:25.424457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:25.437303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.437303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.440425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.441086 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.448694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:25.468393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-871634bf-def3-4dc5-8630-4be00f86931a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.289290 Jul 13 09:08:25.469280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 137/289] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:25 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:25.486970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:25.487578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:25.494280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.494757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.495777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.496210 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.697258 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:25.697442 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:25.700411 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8ba470b0-577a-4c80-8861-1cd0fad20587 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.284405 Jul 13 09:08:25.705566 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b24a5c19-35aa-477e-818a-61bf643d6c54 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.223374 Jul 13 09:08:25.715171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 153/290] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:25 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:25.717333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 138/291] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:25 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:25.722450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:25.723410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:25.732501 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.733165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:25.734109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:25.734686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.079991 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:26.088516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:26.091122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:26.092312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2624e2f0-619e-4217-8b22-669c377059c1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.375813 Jul 13 09:08:26.102526 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 154/292] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:25 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:26.487452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:26.488057 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:26.494897 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:26.495346 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.496119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:26.496560 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.675199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:26.685299 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7996726a-e1d7-488a-baf6-06fa1e3f7697 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.201831 Jul 13 09:08:26.686490 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 139/293] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:26 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:26.726871 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:26.729798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:26.735627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:26.735801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:26.738534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=4 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:26.752864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:26.754170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.755660 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:26.760702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.760702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:26.760702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.761108 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:26.761108 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:26.967938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:26.981185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d18ce4ed-607d-4607-a254-0210e86b654c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.260792 Jul 13 09:08:26.982376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 140/294] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:26 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:26.987569 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:26.999872 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-93e05b50-e83d-4a92-8696-00e96ee0985f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.283163 Jul 13 09:08:27.001118 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 155/295] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:26 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:27.111103 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:27.112327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:27.117953 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:27.119880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:27.120495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:27.121601 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:27.122214 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:27.273520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:27.282027 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:27.284204 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:27.285477 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a2aa2673-96e5-4b68-8255-387f1df3fa0c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.179364 Jul 13 09:08:27.286112 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 141/296] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:27 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:27.705607 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:27.706280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:27.712954 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:27.713534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:27.714257 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:27.714694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:27.894525 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:27.909338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-91e514c0-65b9-4805-8861-d868893766a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.205426 Jul 13 09:08:27.920656 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 156/297] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:27 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:27.999337 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:28.000201 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:28.005471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=8 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:28.017870 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:28.018515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:28.027654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.028097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.028864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.029295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.031764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.032811 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.033868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.034329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.188982 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:28.195177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:28.196429 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c24a00aa-9749-4944-bbdc-0c43fffa5c16 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.201391 Jul 13 09:08:28.197006 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 142/298] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:27 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:28.203139 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a84d7912-e26f-4865-86fc-0c887c15a15a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.190268 Jul 13 09:08:28.204207 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 157/299] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:28 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:28.303785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:28.304408 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:28.311089 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.311580 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.312676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.313308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.460621 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:28.469238 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:28.471022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:28.472222 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a77e43dd-4528-4992-a02d-707d4ae85682 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.172395 Jul 13 09:08:28.472777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 143/300] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:28 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:28.929361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:28.929990 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:28.936285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.936789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:28.937608 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:28.938686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.123613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:29.132976 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3965c84e-f5cd-4f00-89a3-9fb75eb6b5e3 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.207865 Jul 13 09:08:29.133644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 158/301] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:28 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:29.215360 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:29.221419 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:29.225290 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:29.225911 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.226713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:29.226996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:29.227330 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.228584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:29.241665 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:29.246938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.248075 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:29.248904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.426707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:29.438956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9df20cf3-9e93-43b4-b16f-ff8844252c39 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.226575 Jul 13 09:08:29.440233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 144/302] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:29 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:29.448189 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:29.459606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bf23ef11-feed-4c85-8087-ef259624c959 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.236806 Jul 13 09:08:29.460654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 159/303] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:29 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:29.492895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:29.493947 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:29.502301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:29.503038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.503990 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:29.504423 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:29.674224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:29.683420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:29.685402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:29.686690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c0232388-a8b8-4bfc-81af-d6c36e304656 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.199351 Jul 13 09:08:29.692326 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 145/304] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:29 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:30.158714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:30.159515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:30.186706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.187596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.189017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.191117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.433669 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:30.448540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0ed0af56-9bc9-45e0-bc91-5fed7716444f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.294744 Jul 13 09:08:30.449175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 160/305] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:30 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:30.457888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:30.459159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:30.470758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.470758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.470758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.470758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.482002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:30.482951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:30.500692 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.500692 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.500692 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.500692 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.519320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:30.719596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:30.734054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-be05a7a3-e4a8-4c7a-b364-b906485afb05 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.276066 Jul 13 09:08:30.734054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 146/306] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:30 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:30.740946 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:30.740946 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:30.743657 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.744526 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.745775 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:30.746527 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:30.771684 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:30.788734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e57ce654-6e44-4111-a240-7f512f2bb9f9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.310606 Jul 13 09:08:30.791960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 161/307] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:30 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:30.983546 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:30.994657 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:30.996678 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:30.998269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8361403b-0c16-475a-9d78-28d4e55c18e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.266902 Jul 13 09:08:31.002791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 147/308] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:30 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:31.471185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:31.472696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:31.480940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:31.481763 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:31.482833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:31.483496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:31.697688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:31.706220 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-20677f28-286c-4439-98af-b213f4e9f432 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.239859 Jul 13 09:08:31.706799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 162/309] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:31 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:31.749206 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:31.751344 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:31.758893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:31.759622 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:31.760584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:31.761066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:31.807420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:31.808137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:31.820089 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:31.820712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:31.821611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:31.822200 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:31.941936 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:31.952020 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d4d24116-c27d-43d1-97ac-7b981f7f0f1d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.206707 Jul 13 09:08:31.952986 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 148/310] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:31 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:32.020804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:32.021412 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:32.028895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:32.029258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:32.030118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:32.030492 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:32.130347 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:32.145058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-75cb564d-bd72-43da-aba8-e570d672d328 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.342016 Jul 13 09:08:32.145642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 163/311] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:31 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:32.251679 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:32.260763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:32.263609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:32.265282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8f4715a8-cd88-4c9d-af43-a69a10de2552 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.248076 Jul 13 09:08:32.265970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 149/312] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:32 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:32.724714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:32.725315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:32.731832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:32.732280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:32.733254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:32.733693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:32.870089 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:32.879215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b7d73004-5715-46df-91d1-0d73ad2a466e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.158447 Jul 13 09:08:32.879785 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 164/313] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:32 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:32.970156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:32.970781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:32.977150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:32.977606 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:32.978402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:32.978843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.114503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:33.122053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-16d4931e-5e28-443b-8216-c40534c403e1 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.155960 Jul 13 09:08:33.122711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 150/314] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:32 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:33.162676 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:33.163290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:33.169390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:33.169843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.170630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:33.171065 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.284199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:33.284910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:33.291103 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:33.292470 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.292595 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:33.292974 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.301574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:33.309819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-595cb960-69b5-4ec8-b15d-0abe2d51bf79 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.150997 Jul 13 09:08:33.310438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 165/315] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:33 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:33.427024 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:33.434846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:33.436347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:33.437512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-92013a2a-af8b-4374-80be-3719aad03add tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.157327 Jul 13 09:08:33.441547 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 151/316] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:33 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:33.896253 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:33.896913 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:33.903003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:33.903458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.904222 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:33.904664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:33.907714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:34.040648 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:34.048085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4ba5885c-2f07-40d8-856f-7da46aea30af tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.155674 Jul 13 09:08:34.048673 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 166/317] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:33 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:34.140130 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:34.141322 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:34.148119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:34.148509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:34.149269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:34.149709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:34.279021 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:34.287360 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bf988ca8-cd30-46b9-985d-bea942601d71 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.151414 Jul 13 09:08:34.287917 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 152/318] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:34 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:34.327397 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:34.328007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:34.334540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:34.334981 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:34.335768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:34.336204 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:34.463587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:34.464482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:34.471760 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:34.472409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:34.473182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:34.473604 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:34.474229 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:34.481567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5e9a8d72-da23-4f2a-a328-628c351e504d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.157918 Jul 13 09:08:34.491171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 167/319] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:34 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:34.608234 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:34.617059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:34.618633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:34.619760 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a541fd97-d69f-4e55-a72c-71c168e98362 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.160005 Jul 13 09:08:34.620305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 153/320] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:34 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:35.065534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:35.066179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:35.072275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.072731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.073542 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.073970 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.207857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:35.215238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8516cdfd-3b79-48a1-81d8-3c2aea255c83 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.154441 Jul 13 09:08:35.215813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 168/321] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:35 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:35.303839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:35.304565 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:35.311258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.311410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.312132 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.312558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.442810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:35.450338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0850834e-f421-46cc-b897-05ba8aa0d16c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.150817 Jul 13 09:08:35.450903 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 154/322] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:35 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:35.497538 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:35.498263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:35.500157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:35.505490 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.505988 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.506730 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.507162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.639023 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:35.639830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:35.647107 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.647555 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.647715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:35.648326 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:35.648880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:35.656816 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c5c0ae8a-7c3c-4273-bcd7-7bc15b51b80b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.163052 Jul 13 09:08:35.657613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 169/323] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:35 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:35.941543 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:35.945285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:35.947038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:35.948246 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9fd536d1-caec-4e04-9a91-a95b7f449de5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1744 microversion: 2.20 time: 0.313759 Jul 13 09:08:35.948802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 155/324] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:35 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1744 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:36.232765 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:36.233493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:36.240357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.240809 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.241577 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.242013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.379543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:36.387082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1aee30bc-8f28-44e1-9507-a6495a9755b2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.158364 Jul 13 09:08:36.387899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 170/325] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:36 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:36.467781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:36.468412 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:36.474960 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.475403 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.476149 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.476578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.607327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:36.615707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b5be486a-9e52-4b08-978a-7c1be788ccc8 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.151847 Jul 13 09:08:36.616305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 156/326] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:36 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:36.675845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:36.676486 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:36.682478 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.682930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.683689 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.684122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.816047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:36.823961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4bbd0ac6-5f11-43e6-9bca-77ba09e8e59d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.152869 Jul 13 09:08:36.824572 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 171/327] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:36 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:36.967213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:36.967823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:36.974652 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.975102 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:36.975860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:36.976301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.107110 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:37.115956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:37.117601 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:37.127971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a8d8fa16-3548-4758-9197-26bb97ff327c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1744 microversion: 2.20 time: 0.155602 Jul 13 09:08:37.127971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 157/328] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:36 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:37.404896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:37.405464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:37.413624 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:37.414351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.415149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:37.415682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.555424 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:37.562858 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c8018c09-a9eb-4e00-9fe6-f601ef0b1c2d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.161997 Jul 13 09:08:37.563425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 172/329] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:37 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:37.632892 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:37.633519 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:37.641602 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:37.642062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.642826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:37.649472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.841578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:37.842281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:37.849527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:37.850115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.850889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:37.851317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:37.864726 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:37.873414 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4d53f6e6-bf49-4de4-8130-e4b0e746c766 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.244344 Jul 13 09:08:37.874222 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 158/330] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:37 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:37.987748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:37.995949 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b14591d4-813c-48b5-917c-13b91dc9605d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.158358 Jul 13 09:08:37.996518 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 173/331] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:37 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:38.137307 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:38.138197 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:38.145118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:38.148276 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:38.148276 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:38.148276 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:38.336058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:38.344275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:38.345791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:38.347017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5c2382cc-81e2-4cd7-9263-0fd4b83f0b02 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1744 microversion: 2.20 time: 0.213703 Jul 13 09:08:38.347579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 159/332] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:38 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:38.580021 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:38.580628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:38.587258 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:38.587836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:38.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:38.589029 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:38.727549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:38.732869 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-908c8219-1d1a-46ba-801e-7682b72e390d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.156961 Jul 13 09:08:38.733450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 174/333] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:38 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:38.890825 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:38.891432 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:38.897860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:38.898343 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:38.899170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:38.899606 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.016202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:39.017385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:39.031348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.031348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.031348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.031348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.087709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:39.096313 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6f8d57df-2bc8-461c-8640-f83b53c9979c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.209447 Jul 13 09:08:39.107413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 160/334] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:38 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:39.215938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:39.225830 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f24c0bee-44f0-482d-ad39-b0dc1953dfce tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1722 microversion: 2.1 time: 0.216510 Jul 13 09:08:39.227009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 175/335] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:39 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:39.365362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:39.366559 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:39.374545 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.375193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.376302 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.376957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.573203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:39.583619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:39.585285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:39.586604 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f8626c23-6e6f-4cd9-8d6d-9fe41bad05b6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.225514 Jul 13 09:08:39.588296 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 161/336] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:39 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:39.751106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:39.751725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:39.762023 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.763402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.764360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.764962 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.806522 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-b31f8bcb-78cd-476e-a3f7-e348c948063d req-a52dd5d6-792a-4107-b472-92a540fdbfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "name": "network-vif-plugged", "status": "completed", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:39.844618 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-b31f8bcb-78cd-476e-a3f7-e348c948063d req-a52dd5d6-792a-4107-b472-92a540fdbfbb service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:39.846547 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-b31f8bcb-78cd-476e-a3f7-e348c948063d req-a52dd5d6-792a-4107-b472-92a540fdbfbb service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:39.895430 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-b31f8bcb-78cd-476e-a3f7-e348c948063d req-a52dd5d6-792a-4107-b472-92a540fdbfbb service nova] Creating event network-vif-plugged:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:08:39.907352 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-b31f8bcb-78cd-476e-a3f7-e348c948063d req-a52dd5d6-792a-4107-b472-92a540fdbfbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150700 Jul 13 09:08:39.916834 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 162/337] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:40.060479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:40.081548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fa776093-dac1-48f7-948b-58079002aaa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1501 microversion: 2.1 time: 0.331779 Jul 13 09:08:40.081548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 176/338] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:39 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1501 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:40.097213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e551cd-60b0-47a3-9d11-dafd52ab0eac"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:40.100502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:40.105299 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.105759 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.106564 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.107004 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.119714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:40.120330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:40.135153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] HTTP exception thrown: Cannot 'attach_volume' instance 8315445c-678d-4c5c-8ecf-937e48a120a4 while it is in vm_state rescued Jul 13 09:08:40.135987 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.136444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Request method failure captured: Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/os-volume_attachments HTTP/1.1 Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 74 Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosJU0xdskOdcTptAE5bhES6v1ZUimaLvfQtrokc0q7dinMkfp__MPqxaPVSdCgw_F6U_orIDcszlTl8BAm8AtiKOkOz440nNWH1bnO3pwnp82VQ9w7CQLOR_PrGKqaVO0YkEnsPBshTjyu3jwLh2JygaCXrK4J-Yi1JWZz9D7TzlTI Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:08:40.137155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7afbdee349034d2182240f1f7230236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7afbdee349034d2182240f1f7230236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: d9bffb24cf26486a9a8947882b52ec98 Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {"volumeAttachment": {"volumeId": "a0e551cd-60b0-47a3-9d11-dafd52ab0eac"}} Jul 13 09:08:40.138808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Cannot 'attach_volume' instance 8315445c-678d-4c5c-8ecf-937e48a120a4 while it is in vm_state rescued Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'server_id': '8315445c-678d-4c5c-8ecf-937e48a120a4', 'body': {'volumeAttachment': {'volumeId': 'a0e551cd-60b0-47a3-9d11-dafd52ab0eac'}}} Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:08:40.139619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8315445c-678d-4c5c-8ecf-937e48a120a4 while it is in vm_state rescued Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:08:40.140732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:08:40.141785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:08:40.141785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:08:40.141785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8315445c-678d-4c5c-8ecf-937e48a120a4 while it is in vm_state rescued Jul 13 09:08:40.141785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:08:40.142068 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.142533 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Returning 409 to user: Cannot 'attach_volume' instance 8315445c-678d-4c5c-8ecf-937e48a120a4 while it is in vm_state rescued {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:08:40.142617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.142690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9fccc039-7a3b-4dc6-a76a-2fd673aab61d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047333 Jul 13 09:08:40.142690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 163/339] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:08:40 2022] POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 13 09:08:40.150417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:40.150957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:40.157336 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.157858 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.158734 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.159536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.164777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:40.340508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:40.356232 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-436280fe-32ca-4ba4-958d-299f2e84994b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.244132 Jul 13 09:08:40.361727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 177/340] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:40 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:40.370121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:40.376126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:40.384375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.385038 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.387206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.388473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.399475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a25450ff-dc10-471e-8c35-71185cfc9477 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/action" status: 202 len: 0 microversion: 2.1 time: 0.254408 Jul 13 09:08:40.400464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 164/341] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:08:40 2022] POST /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:08:40.416683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:40.417409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:40.433221 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.435162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.436707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.438574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.625780 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:40.635827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c15fa214-9cd2-4eb9-b984-e22fdcff02c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1699 microversion: 2.1 time: 0.271827 Jul 13 09:08:40.636911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 178/342] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:40 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1699 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:40.652215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:40.653574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:40.666915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.668269 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.670001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.670748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.723395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:40.731502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b8d9f05a-9a93-422e-9b0b-a198ea8575b7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1509 microversion: 2.1 time: 0.326570 Jul 13 09:08:40.734752 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 165/343] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:40 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:40.745141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bcc4e108-1a91-435a-88c1-7274f1b45120 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:40.759395 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bcc4e108-1a91-435a-88c1-7274f1b45120 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:40.761919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bcc4e108-1a91-435a-88c1-7274f1b45120 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:40.889659 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bcc4e108-1a91-435a-88c1-7274f1b45120 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Going to try to start instance {{(pid=118253) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 13 09:08:41.005276 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:41.017258 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:41.018982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:41.020138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7754f304-2a7b-4fb5-a03f-470ab9b3c8e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.381896 Jul 13 09:08:41.025567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 179/344] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:40 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:41.124773 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bcc4e108-1a91-435a-88c1-7274f1b45120 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action" status: 202 len: 0 microversion: 2.1 time: 0.387189 Jul 13 09:08:41.125650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 166/345] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:08:40 2022] POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:08:41.135583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:41.136436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:41.145507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.151715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:41.152537 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.152975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:41.380376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:41.381376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:41.396188 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.402630 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:41.403730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.406664 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:41.471178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:41.485026 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-73eeef17-eaad-48ff-bffd-b785dc50e551 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1708 microversion: 2.1 time: 0.353597 Jul 13 09:08:41.485618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 180/346] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:41 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1708 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:41.703130 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:41.714518 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0f1a4e00-b0b7-48f5-a5eb-4db008715dbf tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.337629 Jul 13 09:08:41.715825 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 167/347] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:41 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:41.753657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:41.754808 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:41.770877 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.771507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:41.772420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.772961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:41.948912 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-360024d3-d239-4983-9133-6eff895dcba6 req-567475b9-7a99-45f4-939c-865e7aa730aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "name": "network-vif-plugged", "status": "completed", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:41.957777 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:41.968773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2094c7fb-db3e-41c1-a8fa-0ffdd7a3aac4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1509 microversion: 2.1 time: 0.220609 Jul 13 09:08:41.969903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 181/348] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:41 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:41.978612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-360024d3-d239-4983-9133-6eff895dcba6 req-567475b9-7a99-45f4-939c-865e7aa730aa service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:41.979112 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-360024d3-d239-4983-9133-6eff895dcba6 req-567475b9-7a99-45f4-939c-865e7aa730aa service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.004985 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-360024d3-d239-4983-9133-6eff895dcba6 req-567475b9-7a99-45f4-939c-865e7aa730aa service nova] Creating event network-vif-plugged:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:08:42.010315 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-360024d3-d239-4983-9133-6eff895dcba6 req-567475b9-7a99-45f4-939c-865e7aa730aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066187 Jul 13 09:08:42.011211 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 168/349] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:08:42.044281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:42.045816 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:42.054345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.056937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.058888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.059324 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.211842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:42.214563 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:42.221633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:42.223404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:42.224593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-53e18ed2-9a8e-47e3-9cec-46639af61769 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.185018 Jul 13 09:08:42.225571 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 182/350] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:42 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:42.507203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:42.508155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:42.517232 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.517864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.519782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.520597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.694507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:42.704000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bfdfe0c8-92b5-493c-bf3a-820a9f0c01f5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1708 microversion: 2.1 time: 0.204718 Jul 13 09:08:42.704896 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 169/351] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:42 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1708 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:42.733527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:42.734197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:42.745569 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.746020 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.746842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.747275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.987930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:42.989166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:42.998654 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:42.999113 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:42.999894 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:43.000332 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:43.030549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:43.038123 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5581bffb-8969-4189-9432-a6c52b2212d2 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.309266 Jul 13 09:08:43.040414 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 183/352] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:42 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:43.243950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:43.245475 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:43.271153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:43.272521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:43.273134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:43.273562 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:43.274130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:43.291111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b0c36ed9-ba63-4374-9c27-d022c51d478f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1509 microversion: 2.1 time: 0.307881 Jul 13 09:08:43.294536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 170/353] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:42 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:43.507239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:43.523802 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:43.525645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:43.530963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a72b1f53-5e85-4aa7-81f6-89a9d89aa8f4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.290930 Jul 13 09:08:43.532605 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 184/354] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:43 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:43.721962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:43.723371 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:43.737579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:43.741857 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:43.743027 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:43.747220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.059265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:44.060293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:44.067720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:44.068416 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.069349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:44.070323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.228090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:44.233144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:44.237613 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b4729b81-9b9f-4eff-9985-a4bf67aa4a2c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1708 microversion: 2.1 time: 0.518401 Jul 13 09:08:44.246286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-18dc824e-5df3-4a8d-a165-7fadeed998f9 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.190056 Jul 13 09:08:44.248323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 185/355] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:44 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:44.253873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 171/356] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:43 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1708 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:44.313904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:44.315466 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:44.321990 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:44.323926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.323926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:44.323926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.538087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:44.548609 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9be02bf8-6099-46a9-ab5f-c4d1b61fcbe8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1515 microversion: 2.1 time: 0.240575 Jul 13 09:08:44.554246 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:44.555084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:44.562458 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:44.563190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.564174 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:44.564493 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:44.568810 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 186/357] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:44 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:44.744209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:44.752171 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:44.753690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:44.754887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-eaf88031-987a-47d9-adfc-fc7981a5a062 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.209316 Jul 13 09:08:44.755436 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 172/358] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:44 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:45.256217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:45.257449 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:45.265807 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:45.266540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:45.267526 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:45.268646 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:45.269827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:45.273907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:45.277524 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:45.278449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:45.285736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:45.285736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:45.552325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:45.560611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6fdf5a4a-61db-4d97-b9bf-ac031ebd2d5c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1712 microversion: 2.1 time: 0.308233 Jul 13 09:08:45.571550 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 187/359] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:45 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1712 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:45.595772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:45.604929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-10e7960c-431d-4a96-a056-a5edae1156f3 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1358 microversion: 2.1 time: 0.343476 Jul 13 09:08:45.605492 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 173/360] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:45 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:45.773720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:45.774978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:45.781580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:45.782047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:45.782841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:45.783284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:45.967151 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:45.977254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:45.979014 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:45.980384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3c4fe5fe-5087-428a-ba40-0c675ec0a802 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.211311 Jul 13 09:08:45.980944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 188/361] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:45 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:46.507723 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a4328991-7daf-45fc-8a26-29cdb2258d2b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'create', calling method: .version_select at 0x7fad222001f0>, body: {"keypair": {"name": "tempest-keypair-1437501013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaJZVHJVAa5Bvmx/zT1h9mQTBhYpJmCOSXFELONomw/HpuJ3QqLWbK9ZdBJBATZyNIHT2RcVe08VOI2hwmdUGUOzdP9SZiTNAQrUS/MOYAMvqbkXuHqnF198XPYssvMCA=="}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:46.529815 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-a4328991-7daf-45fc-8a26-29cdb2258d2b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for project 7afbdee349034d2182240f1f7230236f. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:08:46.534238 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-a4328991-7daf-45fc-8a26-29cdb2258d2b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for user d9bffb24cf26486a9a8947882b52ec98 and project 7afbdee349034d2182240f1f7230236f. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:08:46.546204 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:46.622701 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:46.623308 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:46.633521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:46.634268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:46.635215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:46.636881 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:46.638926 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a4328991-7daf-45fc-8a26-29cdb2258d2b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136043 Jul 13 09:08:46.648410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 174/362] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:08:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:46.989269 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:47.000309 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:47.000931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:47.029015 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.029471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.035050 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d5cc0ae4-dd09-4032-a1c2-00f80cb7760c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1548 microversion: 2.1 time: 0.409811 Jul 13 09:08:47.036438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.037064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.047304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 189/363] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:46 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1548 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:47.058114 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:47.058713 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:47.074969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.079621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.081655 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.084472 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.246219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:47.258870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:47.260473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:47.261642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ed057e39-a246-46c2-b7f7-37fb31ef0f79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.266497 Jul 13 09:08:47.264002 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 175/364] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:46 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:47.458743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:47.467156 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bef3cf0b-52f0-48c8-9672-10816b8af240 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1548 microversion: 2.1 time: 0.415982 Jul 13 09:08:47.470657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 190/365] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:47 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1548 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:47.490205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:47.495114 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:47.496104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Searching by: {'deleted': False, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70'} {{(pid=118253) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 13 09:08:47.526426 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.527110 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.528032 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.528476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.662319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.multi_cell_list [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118253) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 13 09:08:47.779837 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bce3b7b3-189b-4940-b910-a72c268e613f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.295294 Jul 13 09:08:47.786173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 176/366] 10.222.0.40 () {58 vars in 1124 bytes} [Wed Jul 13 09:08:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:47.795935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:47.796750 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:47.808817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.809747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:47.810838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:47.814735 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:48.266749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:48.280821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:48.281631 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:48.295720 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:48.296145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:48.300155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0bcea92a-7779-439f-be91-9f3f757b71ad tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1548 microversion: 2.1 time: 0.508344 Jul 13 09:08:48.301613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 191/367] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:47 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1548 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:48.302383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:48.303087 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:48.785280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:48.803312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:48.805983 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:48.813404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-99ea9c3d-09ad-4865-a80b-28001cc248e5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.533698 Jul 13 09:08:48.817806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 177/368] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:48 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:49.835540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:49.836233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:49.851917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:49.851917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:49.851917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:49.851917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:50.116749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:50.125734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:50.127836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:50.130984 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d32de5d9-acd4-494d-aad1-ba3cad9bbe85 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.299407 Jul 13 09:08:50.163108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 192/369] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:49 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:50.698855 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2ddbb45-dba9-40d3-8364-049b30b8c370"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:50.700848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:50.719071 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:50.719525 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:50.722998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:50.723517 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:50.859038 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-612033951", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66664860-8484-4278-a13a-d19d7f467709"}], "security_groups": [{"name": "tempest-securitygroup--1873825380"}], "key_name": "tempest-keypair-1437501013", "user_data": "}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:51.126218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] validate_networks() for [('66664860-8484-4278-a13a-d19d7f467709', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:08:51.639006 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:51.765282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-026d82fa-551e-4ed7-9475-87f96d25bfee tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.071702 Jul 13 09:08:51.766727 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 178/370] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:08:50 2022] POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments => generated 194 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:51.791373 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:51.797388 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:51.809808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:51.813269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:51.814295 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:51.814933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:52.088524 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:52.148141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:52.165807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:52.167717 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-035dcbbf-a762-43dd-bcde-280ec62f3571 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.399304 Jul 13 09:08:52.168290 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 179/371] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:51 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:52.183562 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:08:52.185271 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:08:52.185919 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:08:52.186580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:08:52.187974 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:08:52.212037 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:52.212956 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:52.217786 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:52.228619 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:52.246357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for project 7afbdee349034d2182240f1f7230236f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:08:52.253723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Getting quotas for user d9bffb24cf26486a9a8947882b52ec98 and project 7afbdee349034d2182240f1f7230236f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:08:52.271900 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:08:52.275840 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:08:52.468284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-818745d2-464a-4db0-a103-79d9ef66dfd6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.613370 Jul 13 09:08:52.475690 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 193/372] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:08:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 09:08:52.481676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c38b3560-5b49-4c0a-8965-2ae3252ec8d4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:52.482928 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c38b3560-5b49-4c0a-8965-2ae3252ec8d4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:52.556987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c38b3560-5b49-4c0a-8965-2ae3252ec8d4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:52.569340 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c38b3560-5b49-4c0a-8965-2ae3252ec8d4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1245 microversion: 2.1 time: 0.093230 Jul 13 09:08:52.570045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 180/373] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:52 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:53.187051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:53.198679 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:53.206530 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:53.206911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:53.207686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:53.208121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:53.587034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:53.588338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:53.612506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:53.615470 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:53.616676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:53.617603 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:53.759779 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:53.774361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-42e10176-e57a-4958-8539-715bd543021d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1249 microversion: 2.1 time: 0.190757 Jul 13 09:08:53.784074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 181/374] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:53 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1249 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:08:54.100416 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:54.112635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:54.115184 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:54.120888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0f2ec1ef-97aa-49ab-b4e9-b08d74181572 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.934476 Jul 13 09:08:54.134135 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 194/375] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:53 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:54.792882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:54.794381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:54.805963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:54.806761 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:54.808459 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:54.809090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:54.960539 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:54.985356 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f0b00a43-6440-49e4-a7d6-f7c2acba8bf7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1297 microversion: 2.1 time: 0.198120 Jul 13 09:08:55.000153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 182/376] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:54 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1297 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:55.164224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:55.165009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:55.171764 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:55.172217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:55.173006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:55.173444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:55.341638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:55.351228 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:55.352845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:55.354163 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-35edff66-7a30-43e7-a64d-9cc41aa609cb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.194152 Jul 13 09:08:55.354832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 195/377] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:55 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:08:56.008321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:56.009093 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:56.027792 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:56.033259 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:56.033259 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:56.033259 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:56.238456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:56.259277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1e13b4b3-1d20-4cef-a6ae-0d38d1027763 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1305 microversion: 2.1 time: 0.256125 Jul 13 09:08:56.274941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 183/378] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:56 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:56.374806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:56.375510 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:56.389564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:56.390017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:56.390838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:56.391282 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:56.734568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:56.750464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:56.761926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:56.772120 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-591d902d-7212-4f7b-ab00-435da64093d1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.397772 Jul 13 09:08:56.773034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 196/379] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:56 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:57.291681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:57.294505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:57.318519 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:57.319087 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:57.321966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:57.324104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:57.610527 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:57.790126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:57.790663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:57.797361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:57.797815 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:57.798684 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:57.799644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:57.812873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:57.822177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-755db850-a7c4-4920-b049-de4b4dc2c535 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.535177 Jul 13 09:08:57.823068 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 184/380] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:57 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:57.959239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:57.976912 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:57.978548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:57.980274 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b764049f-e3b7-4f88-9eb2-591decfc7f07 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.194306 Jul 13 09:08:57.980893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 197/381] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:57 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:08:58.552258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-c11be679-c963-4176-9ca6-ec0df20875f5 req-d5b222bc-de66-439d-8559-71db4990bcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84256c-3f8c-43e1-9c7d-2a433978a7bd", "tag": "5e405f48-99d1-4184-bb1c-d187e2f9e912"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:08:58.575444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-c11be679-c963-4176-9ca6-ec0df20875f5 req-d5b222bc-de66-439d-8559-71db4990bcb8 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:58.575444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-c11be679-c963-4176-9ca6-ec0df20875f5 req-d5b222bc-de66-439d-8559-71db4990bcb8 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:58.598627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-c11be679-c963-4176-9ca6-ec0df20875f5 req-d5b222bc-de66-439d-8559-71db4990bcb8 service nova] Creating event network-changed:5e405f48-99d1-4184-bb1c-d187e2f9e912 for instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd on hv-cinder-84962 Jul 13 09:08:58.605198 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-c11be679-c963-4176-9ca6-ec0df20875f5 req-d5b222bc-de66-439d-8559-71db4990bcb8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057773 Jul 13 09:08:58.606543 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 185/382] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:08:58.841774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:58.843197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:58.858885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:58.859680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:58.860672 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:58.861408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:59.001613 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:08:59.002944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:08:59.022323 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:59.023148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:59.024467 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:08:59.026008 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:08:59.035293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:59.040784 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d5c226f8-2ba6-4752-a2e3-ed06778a0ffe tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.204040 Jul 13 09:08:59.041963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 198/383] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:08:58 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:08:59.500147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:59.509612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:59.511859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:08:59.513350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-365b1622-5221-4ef4-9f3c-a9323699b5f5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1739 microversion: 2.20 time: 0.517673 Jul 13 09:08:59.514200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 186/384] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:08:58 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:09:00.057665 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:00.058307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:00.065286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:00.065827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:00.066870 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:00.067271 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:00.233326 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:00.243644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3787d15f-d69c-4662-9217-b70e5827626b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.189635 Jul 13 09:09:00.256328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 199/385] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:00 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:00.531466 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:00.532542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:00.539637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:00.540374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:00.541378 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:00.541998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:00.979611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:00.981429 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:00.986563 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:00.995956 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:00.996673 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:00.997658 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:00.998554 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:01.003683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:01.003683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:01.004755 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fafb2378-609d-430b-be04-f83542b210cd tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1721 microversion: 2.20 time: 0.477245 Jul 13 09:09:01.006580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:01.017722 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 187/386] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:00 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1721 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:01.178780 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:01.188791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1ffed1e5-7f13-496e-9ee0-557e638963ba tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1594 microversion: 2.1 time: 0.216428 Jul 13 09:09:01.190025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 200/387] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:00 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1594 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:01.263024 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:01.263641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:01.270798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:01.271182 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:01.279017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:01.279475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:01.559917 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:01.568373 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9321972a-9b24-4a65-a949-ab2c2c651575 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.309416 Jul 13 09:09:01.568941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 188/388] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:01 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:02.036619 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:02.037225 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:02.043785 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:02.044463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:02.049543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:02.049543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:02.233360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:02.267167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:02.290726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:02.305303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:02.307769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:02.309134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cb09d31a-8c21-4d3b-8225-7b530e97bc4f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1721 microversion: 2.20 time: 0.277463 Jul 13 09:09:02.309880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 201/389] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:02 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:02.584873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:02.586436 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:02.593200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:02.595247 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:02.596072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:02.597698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:02.598817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:02.841245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:02.852505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4efae291-36bb-4f35-b5d0-7db80984817c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.268842 Jul 13 09:09:02.854121 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 189/390] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:02 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:03.329134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:03.330807 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:03.364930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:03.365442 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:03.367214 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:03.367672 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:03.727157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:03.775821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:03.778541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:03.780496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f38bd225-535b-4ecd-8eab-c4d99eb85360 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1721 microversion: 2.20 time: 0.454937 Jul 13 09:09:03.782156 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 202/391] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:03 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1721 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:03.889302 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:03.893205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:03.912090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:03.912827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:03.919714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:03.919714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:03.972056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-eea31517-558d-4bc0-bd20-6248f5f5169a req-ba6ecec2-9475-42e9-9821-a6621080bda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:03.993975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-eea31517-558d-4bc0-bd20-6248f5f5169a req-ba6ecec2-9475-42e9-9821-a6621080bda5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:03.994736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-eea31517-558d-4bc0-bd20-6248f5f5169a req-ba6ecec2-9475-42e9-9821-a6621080bda5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:04.018778 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-eea31517-558d-4bc0-bd20-6248f5f5169a req-ba6ecec2-9475-42e9-9821-a6621080bda5 service nova] Creating event network-changed:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:09:04.025152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-eea31517-558d-4bc0-bd20-6248f5f5169a req-ba6ecec2-9475-42e9-9821-a6621080bda5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064377 Jul 13 09:09:04.026585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 203/392] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:09:04.033554 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-2a79cfb7-428b-421e-9327-041c06a3f7b3 req-dcedbf25-181e-4448-8b99-c28521c10c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "name": "network-vif-unplugged", "status": "completed", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:04.043197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-2a79cfb7-428b-421e-9327-041c06a3f7b3 req-dcedbf25-181e-4448-8b99-c28521c10c37 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:04.044062 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-2a79cfb7-428b-421e-9327-041c06a3f7b3 req-dcedbf25-181e-4448-8b99-c28521c10c37 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:04.071637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-2a79cfb7-428b-421e-9327-041c06a3f7b3 req-dcedbf25-181e-4448-8b99-c28521c10c37 service nova] Creating event network-vif-unplugged:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:09:04.085152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-2a79cfb7-428b-421e-9327-041c06a3f7b3 req-dcedbf25-181e-4448-8b99-c28521c10c37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055286 Jul 13 09:09:04.088289 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 204/393] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:09:04.376081 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:04.388239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b08863a2-bf36-4195-9aef-99659ff86ca7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.518505 Jul 13 09:09:04.389593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 190/394] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:03 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:04.801098 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:04.802468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:04.822367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:04.823255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:04.824302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:04.824953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:05.044796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:05.055202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:05.056993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:05.058410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9a3c2f81-1fd0-4e61-984d-f8981efecc33 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1724 microversion: 2.20 time: 0.262994 Jul 13 09:09:05.059337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 205/395] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:04 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:05.092526 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2763c97a-1365-44c7-99c1-431311e57a45"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:05.101640 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:05.112075 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:05.112792 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:05.113841 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:05.114467 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:05.418042 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:05.418675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:05.435485 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:05.439275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:05.443613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:05.474560 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:05.743929 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:05.754821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fd048d09-6e00-4400-848c-2b37637fcc16 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.352021 Jul 13 09:09:05.756039 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 206/396] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:05 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:06.072288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-464e5db2-5f21-4a2c-9b52-7303ae559fc6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Action: 'create', calling method: .version_select at 0x7fad21c71790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2103770607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4KJcyqU5BpqnR6mV3n6+MThCHs/bYl0c4Ao1sAa6f/QBUI1WvHn8Wj1oMooRFdpfdXjP/iiIj9CMPv2Bjrxt4rPB25hM3u6MQQ5F/GlL16m/PIRudK4dLS6vtONTuyxw=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:06.076453 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:06.088365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-464e5db2-5f21-4a2c-9b52-7303ae559fc6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for project 02051a1f629a48199bb1eb504c747294. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:09:06.093540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-464e5db2-5f21-4a2c-9b52-7303ae559fc6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for user 6f101dab08684c2483f67a9357efeae8 and project 02051a1f629a48199bb1eb504c747294. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:09:06.184685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-464e5db2-5f21-4a2c-9b52-7303ae559fc6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.369515 Jul 13 09:09:06.185296 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 207/397] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:09:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:09:06.439733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-eae3436c-6ec4-44ea-b39b-8148c995e796 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.365906 Jul 13 09:09:06.440766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 191/398] 10.222.0.40 () {62 vars in 1363 bytes} [Wed Jul 13 09:09:05 2022] POST /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments => generated 188 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:09:06.612881 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:06.613698 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:06.621108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:06.621733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:06.623234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:06.623814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:06.774052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:06.778328 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:06.785209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:06.785660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:06.786522 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:06.787751 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:06.902444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7d5e27dd-6c14-4537-a970-b15cc95a572d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/action" status: 202 len: 0 microversion: 2.20 time: 0.295408 Jul 13 09:09:06.903254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 208/399] 10.222.0.40 () {62 vars in 1318 bytes} [Wed Jul 13 09:09:06 2022] POST /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:09:06.913221 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:06.913902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:06.921094 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:06.921666 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:06.922471 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:06.923185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:06.964431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:06.967652 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f68d257c-5009-4493-bbe1-1adc88451d65 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.196870 Jul 13 09:09:06.978215 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 192/400] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:06 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:07.109284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:07.120352 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:07.122495 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:07.123739 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fd086f4d-12b6-4489-a675-3abd08dd25b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1750 microversion: 2.20 time: 0.216237 Jul 13 09:09:07.130255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 209/401] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:06 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:07.626416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1262489158"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:07.627615 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:07.637104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:07.637562 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:07.638386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:07.638827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:07.936404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-04d82df9-2e33-4d02-b42c-7d2e68f61026 req-c26a66ac-c04a-43e3-9303-3bdf30765b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84256c-3f8c-43e1-9c7d-2a433978a7bd", "name": "network-vif-plugged", "status": "completed", "tag": "5e405f48-99d1-4184-bb1c-d187e2f9e912"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:07.951127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-04d82df9-2e33-4d02-b42c-7d2e68f61026 req-c26a66ac-c04a-43e3-9303-3bdf30765b30 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:07.955242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.network.security_group_api [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Adding security group d530a976-4a4c-4f30-adae-2bc85cfa2b96 to port 85a58c92-11ad-4ae8-b43c-cd72f892cc97 Jul 13 09:09:07.959463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-04d82df9-2e33-4d02-b42c-7d2e68f61026 req-c26a66ac-c04a-43e3-9303-3bdf30765b30 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:07.978923 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-04d82df9-2e33-4d02-b42c-7d2e68f61026 req-c26a66ac-c04a-43e3-9303-3bdf30765b30 service nova] Creating event network-vif-plugged:5e405f48-99d1-4184-bb1c-d187e2f9e912 for instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd on hv-cinder-84962 Jul 13 09:09:07.992433 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-04d82df9-2e33-4d02-b42c-7d2e68f61026 req-c26a66ac-c04a-43e3-9303-3bdf30765b30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059980 Jul 13 09:09:07.997820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 210/402] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:09:08.007705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:08.018440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:08.043986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.044522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.045206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.045644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.380138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:08.387803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-676b4207-515e-4721-b061-3abd75623e17 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.388098 Jul 13 09:09:08.388943 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 211/403] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:07 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:08.409644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:08.410611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:08.426113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.429166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.430410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.431133 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.706389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:08.718096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:08.720861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:08.723746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9241be3d-6359-4481-a885-256fc08701e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1750 microversion: 2.20 time: 0.332193 Jul 13 09:09:08.723746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 212/404] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:08 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1750 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:08.873610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8db22437-3e6a-425e-a4cc-c90570304355 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/action" status: 202 len: 0 microversion: 2.1 time: 1.252171 Jul 13 09:09:08.874996 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 193/405] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:09:07 2022] POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/action => generated 0 bytes in 1254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:09:08.887206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:08.887970 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:08.893830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-329edf1b-9b9b-4927-8f07-c8e83cf32b0a req-91155ea2-02f2-45a5-9d2c-713d18afb9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:08.901854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.901854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.901854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.901854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.914864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-329edf1b-9b9b-4927-8f07-c8e83cf32b0a req-91155ea2-02f2-45a5-9d2c-713d18afb9cb service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:08.915385 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-329edf1b-9b9b-4927-8f07-c8e83cf32b0a req-91155ea2-02f2-45a5-9d2c-713d18afb9cb service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:08.959169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-329edf1b-9b9b-4927-8f07-c8e83cf32b0a req-91155ea2-02f2-45a5-9d2c-713d18afb9cb service nova] Creating event network-changed:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:09:08.970480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-329edf1b-9b9b-4927-8f07-c8e83cf32b0a req-91155ea2-02f2-45a5-9d2c-713d18afb9cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083080 Jul 13 09:09:08.971665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 194/406] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:09:09.181841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:09.195415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-32e6ca6b-c66a-45de-b59b-4e4e9ea38953 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1760 microversion: 2.1 time: 0.313650 Jul 13 09:09:09.212000 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 213/407] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:08 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1760 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:09.407538 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:09.408574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:09.416930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:09.417633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:09.418665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:09.419407 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:09.441899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:09.601336 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:09.609700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9d1eba5d-f43d-4f16-b325-8315e3d660ad tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1371 microversion: 2.1 time: 0.208390 Jul 13 09:09:09.610479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 195/408] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:09 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:09.741314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:09.741918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:09.747938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:09.748382 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:09.749142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:09.749575 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:09.906535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:09.920228 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:09.923685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:09.925227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-dff18203-d700-4417-97d4-01f3c280d737 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1752 microversion: 2.20 time: 0.187817 Jul 13 09:09:09.926199 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 214/409] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:09 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:10.627335 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:10.627971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:10.635040 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:10.635479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:10.636475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:10.636902 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:10.788252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:10.796053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dc933147-025b-4894-adc9-ebfc51e85a63 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1566 microversion: 2.1 time: 0.172715 Jul 13 09:09:10.796786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 196/410] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:10 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:10.812599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:10.813144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:10.821177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:10.821633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:10.822436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:10.822878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:10.903827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b3a1bc0b-2b01-445b-9cb4-e0bc28b2d59b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095093 Jul 13 09:09:10.904423 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 215/411] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:09:10 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:09:10.944507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:10.945196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:10.952686 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:10.953204 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:10.954588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:10.955115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:11.211504 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:11.222471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:11.224368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:11.225938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-efe9870e-8eed-4361-b360-2f78cead3219 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1752 microversion: 2.20 time: 0.285426 Jul 13 09:09:11.230431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 197/412] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:10 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1752 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:12.197521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-d602776e-225a-40e4-a580-c2d91fd4adcf req-5c71eb1f-6214-470e-8a0d-b5261003b072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84256c-3f8c-43e1-9c7d-2a433978a7bd", "tag": "5e405f48-99d1-4184-bb1c-d187e2f9e912"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:12.207413 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-d602776e-225a-40e4-a580-c2d91fd4adcf req-5c71eb1f-6214-470e-8a0d-b5261003b072 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:12.207925 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-d602776e-225a-40e4-a580-c2d91fd4adcf req-5c71eb1f-6214-470e-8a0d-b5261003b072 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:12.219042 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-d602776e-225a-40e4-a580-c2d91fd4adcf req-5c71eb1f-6214-470e-8a0d-b5261003b072 service nova] Creating event network-changed:5e405f48-99d1-4184-bb1c-d187e2f9e912 for instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd on hv-cinder-84962 Jul 13 09:09:12.224717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-d602776e-225a-40e4-a580-c2d91fd4adcf req-5c71eb1f-6214-470e-8a0d-b5261003b072 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030766 Jul 13 09:09:12.225955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 216/413] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:09:12.246481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:12.247339 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:12.255180 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:12.255627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:12.256405 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:12.256842 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:12.608799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:12.619007 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:12.620554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:12.621728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3b4229b7-a158-4e50-8fcb-df2b0181a4be tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.379383 Jul 13 09:09:12.622542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 198/414] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:12 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:13.640694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:13.641454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:13.649927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:13.649927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:13.649927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:13.649927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:13.787431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:13.796007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:13.797524 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:13.798752 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-97e978ee-ee52-4b6e-b632-4752f4f02496 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.162936 Jul 13 09:09:13.801985 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 217/415] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:13 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:14.818208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:14.819633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:14.826172 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:14.826713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:14.827646 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:14.828191 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:15.009286 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:15.020083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:15.021638 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:15.022815 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ae05eb8b-e240-44da-b6fa-6b61a7ec1d60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.210006 Jul 13 09:09:15.023987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 199/416] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:14 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:16.041295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:16.041934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:16.049219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:16.049868 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:16.050874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:16.051308 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:16.103117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=4 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:16.200446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:16.209545 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:16.211138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:16.221774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-747b93da-e30c-4444-8ce6-2915ce2d40b8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.175006 Jul 13 09:09:16.221774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 218/417] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:16 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:17.238171 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:17.239482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:17.242050 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:17.247250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:17.247947 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:17.248939 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:17.249523 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:17.401998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:17.413818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:17.415809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:17.417850 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9f3ecdb8-7e20-417e-967b-1415d1dc79d2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.183671 Jul 13 09:09:17.418880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 200/418] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:17 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:18.436817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:18.437443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:18.444412 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:18.445055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:18.446102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:18.446581 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:18.595806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:18.598080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:18.605401 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:18.606930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:18.608127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-647f64bf-32c3-4886-8e26-c8018f69fc91 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.175340 Jul 13 09:09:18.608675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 219/419] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:18 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:19.628970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:19.629800 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:19.637077 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:19.637612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:19.638448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:19.638922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:19.797921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:19.807368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:19.808941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:19.810141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c9df1718-f7b8-40b5-b1b2-45defc338012 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.186307 Jul 13 09:09:19.822517 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 201/420] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:19 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:20.829424 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:20.831130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:20.838925 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:20.839844 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:20.847439 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:20.848328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:20.999859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:21.009419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:21.011239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:21.012518 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bf1d030b-e67e-4941-9dab-ec01d7a191bb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.187497 Jul 13 09:09:21.024628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 220/421] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:20 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:09:22.031944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:22.032579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:22.040054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:22.040603 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:22.041459 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:22.041970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:22.244560 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:22.253374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:22.254915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:22.256074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7360ab7c-9ef7-4a00-83f2-db7ca620f2ee tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.228145 Jul 13 09:09:22.256627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 202/422] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:22 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:23.275044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:23.275662 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:23.282323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:23.282917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:23.284450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:23.285009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:23.425139 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:23.433745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:23.436476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:23.438014 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c8e5e149-669f-4d2f-a227-3261e501ec08 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.167286 Jul 13 09:09:23.438657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 221/423] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:23 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:24.457447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:24.458267 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:24.464733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:24.465190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:24.465959 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:24.466426 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:24.597394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:24.605626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:24.607171 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:24.608305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f58cd836-6744-41a0-a4bc-94826d6a93d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.155536 Jul 13 09:09:24.608892 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 203/424] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:24 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:25.626187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:25.626791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:25.633172 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:25.633629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:25.634427 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:25.634985 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:25.765945 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:25.775258 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:25.776777 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:25.777933 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e9c72c20-df6a-449d-9891-23f1d13769ac tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.155633 Jul 13 09:09:25.778527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 222/425] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:25 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:26.796667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:26.797274 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:26.804604 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:26.805059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:26.805835 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:26.806305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:26.936321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:26.945108 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:26.946697 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:26.947792 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2415dee2-d93b-4670-84e7-9e35f39d1055 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.155024 Jul 13 09:09:26.948342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 204/426] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:26 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:27.967322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:27.970862 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:27.974507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:27.975061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:27.975966 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:27.976448 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:28.111589 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:28.121579 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:28.123121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:28.124293 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9836e7fa-95e3-4ef1-917f-74fbaddf0fe2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.162067 Jul 13 09:09:28.124854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 223/427] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:27 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:28.876752 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-925215661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2103770607", "security_groups": [{"name": "tempest-secgroup-smoke-1950628113"}], "block_device_mapping_v2": [{"uuid": "d9e32da9-45d4-4c4f-b777-dd8c91a74f11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b440154-a6c9-4139-b7ed-df54c627be50"}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:28.988821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] validate_networks() for [('3b440154-a6c9-4139-b7ed-df54c627be50', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:09:29.144590 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:29.145202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:29.153033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:29.153624 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:29.154473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:29.154903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:29.299086 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:29.308660 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:29.310191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:29.311399 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1ebfc0f7-8c6e-44bc-b714-ac8e387b1a60 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.171055 Jul 13 09:09:29.312159 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 224/428] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:29 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:09:29.371002 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:09:29.371424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:09:29.371892 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:09:29.372301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:09:29.372706 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:09:29.383162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:29.384768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:29.384768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:29.385118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:29.401933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for project 02051a1f629a48199bb1eb504c747294. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:09:29.405934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for user 6f101dab08684c2483f67a9357efeae8 and project 02051a1f629a48199bb1eb504c747294. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:09:29.464319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:09:29.466474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9e32da9-45d4-4c4f-b777-dd8c91a74f11',volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:09:29.887094 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1197f947-a47d-41ff-8ffc-8025caea7b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.014097 Jul 13 09:09:29.892803 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 205/429] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:09:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:09:29.898516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8236c3f7-13a4-4060-86dd-2cc91871cb52 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:29.902771 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8236c3f7-13a4-4060-86dd-2cc91871cb52 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:29.969243 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8236c3f7-13a4-4060-86dd-2cc91871cb52 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:29.976635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8236c3f7-13a4-4060-86dd-2cc91871cb52 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1094 microversion: 2.1 time: 0.082602 Jul 13 09:09:29.977234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 225/430] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:29 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:30.330936 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:30.331541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:30.338578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:30.343176 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:30.343176 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:30.343176 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:30.492661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:30.502119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:30.503770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:30.505798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-558f18ce-64a0-44f8-a138-a15b067e836d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.178466 Jul 13 09:09:30.506554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 206/431] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:30 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:30.995132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:30.995132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:31.000965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:31.001416 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:31.002225 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:31.002668 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:31.065348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:31.072486 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b4e01d48-7f88-450a-9245-732e232badf4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1144 microversion: 2.1 time: 0.082302 Jul 13 09:09:31.073062 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 226/432] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:30 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:31.524977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:31.525585 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:31.532177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:31.532626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:31.533383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:31.533820 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:31.668038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:31.676788 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:31.678276 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:31.679418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0555a3ff-4190-4e40-8236-eb17b9c49af0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.158840 Jul 13 09:09:31.679966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 207/433] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:31 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:32.090250 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:32.090791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:32.096632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:32.097078 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:32.097831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:32.098299 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:32.159340 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:32.167178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a6b751f4-a9ee-40da-8ecb-da116d11d54d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1144 microversion: 2.1 time: 0.080952 Jul 13 09:09:32.169700 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 227/434] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:32 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:32.697565 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:32.698219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:32.704816 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:32.705266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:32.706042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:32.706498 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:32.839050 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:32.847717 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:32.849597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:32.850778 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b9f9a96f-30f0-497b-8e1f-ead68d83224f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.157079 Jul 13 09:09:32.851338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 208/435] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:32 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:33.184134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:33.184745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:33.191162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:33.191616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:33.192409 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:33.193533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:33.253711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:33.261958 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e715cebd-57d4-432f-b551-fd4e8579bc4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1144 microversion: 2.1 time: 0.081690 Jul 13 09:09:33.262576 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 228/436] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:33 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:33.869119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:33.869729 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:33.876242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:33.876696 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:33.877467 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:33.877906 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:34.003919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:34.012736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:34.014293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:34.015443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7c5eeebb-c6e9-4d10-bbd5-9ba4e1445d6b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.150238 Jul 13 09:09:34.016001 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 209/437] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:33 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:34.278734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:34.279369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:34.285336 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:34.286137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:34.286541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:34.286972 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:34.351743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:34.359350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9aaa1213-6e08-41b5-b7b1-0a54b2c0011d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1144 microversion: 2.1 time: 0.084371 Jul 13 09:09:34.359923 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 229/438] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:34 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:35.034218 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:35.034845 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:35.041779 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:35.042271 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:35.043036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:35.043475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:35.171183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:35.180256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:35.181812 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:35.182984 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-12a6d639-6da9-447d-87a3-ce2e9e2566ab tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.152706 Jul 13 09:09:35.183532 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 210/439] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:35 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:35.376883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:35.378344 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:35.384333 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:35.384773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:35.385857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:35.386322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:35.448195 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:35.455680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-eb513320-a1eb-4c1a-9b08-85aaa81242cd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1144 microversion: 2.1 time: 0.083088 Jul 13 09:09:35.456244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 230/440] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:35 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:36.201290 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:36.201912 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:36.208604 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:36.209058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:36.209831 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:36.210303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:36.355770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:36.364283 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:36.366485 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:36.367822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9ab9e2b7-1320-4780-95a7-c64ddf2b3dbc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.170503 Jul 13 09:09:36.368386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 211/441] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:36 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:36.474076 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:36.475627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:36.481951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:36.482675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:36.483530 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:36.483967 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:36.548149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:36.556509 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7ddc4d53-b36c-4abc-8c81-d546e2948f87 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1200 microversion: 2.1 time: 0.086924 Jul 13 09:09:36.557088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 231/442] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:36 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:37.148120 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:37.148491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:37.164631 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:37.165083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:37.165888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:37.166355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:37.375863 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:37.386981 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lazy-loading 'services' on Instance uuid eb4e5e88-6062-46c0-92b1-4f21fe81b697 {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:09:37.388830 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:37.389455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:37.394854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:37.398066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:37.398066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:37.398794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:37.399242 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:37.567576 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:37.579547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:37.581186 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:37.582509 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4be68f68-d396-41bd-b080-96b93df3cbf5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.198989 Jul 13 09:09:37.583146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 232/443] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:37 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:09:37.594717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:37.595358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:37.601358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:37.601840 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:37.602831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:37.607818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:37.751372 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:37.762167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-92a3e470-4c08-40a6-b6a8-59dbf276719d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1278 microversion: 2.1 time: 0.176977 Jul 13 09:09:37.763328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 233/444] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:37 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:37.958255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-133b7fdb-e6c9-4eaa-8690-9a93cd9a3d74 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-volume_attachments/852af400-b239-4e51-a452-994aac67e783" status: 202 len: 0 microversion: 2.1 time: 0.815838 Jul 13 09:09:37.962159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 212/445] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:09:37 2022] DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-volume_attachments/852af400-b239-4e51-a452-994aac67e783 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:09:38.175749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-bfcb9e2b-2c4f-4f1f-847e-12ec4cbb18a6 req-d3fc2c71-ecc1-411d-baed-dad74457e03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028cc5e6-e410-40e7-8327-d4dbe5b6c0d3", "tag": "41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:38.186849 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-bfcb9e2b-2c4f-4f1f-847e-12ec4cbb18a6 req-d3fc2c71-ecc1-411d-baed-dad74457e03c service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:38.187506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-bfcb9e2b-2c4f-4f1f-847e-12ec4cbb18a6 req-d3fc2c71-ecc1-411d-baed-dad74457e03c service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:38.206530 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-bfcb9e2b-2c4f-4f1f-847e-12ec4cbb18a6 req-d3fc2c71-ecc1-411d-baed-dad74457e03c service nova] Creating event network-changed:41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d for instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 on hv-cinder-84962 Jul 13 09:09:38.211534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-bfcb9e2b-2c4f-4f1f-847e-12ec4cbb18a6 req-d3fc2c71-ecc1-411d-baed-dad74457e03c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039476 Jul 13 09:09:38.212464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 234/446] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:09:38.602381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:38.603070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:38.609416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:38.609880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:38.610676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:38.611104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:38.769934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:38.779311 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:38.780396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:38.780863 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:38.781088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:38.781970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7529efba-0340-4d73-a55f-b922af550972 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.184846 Jul 13 09:09:38.782730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 213/447] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:38 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:38.787286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:38.787941 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:38.788704 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:38.789132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:38.918685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:38.926496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0ff951ad-0659-4a22-8d89-d30f995fe434 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.150314 Jul 13 09:09:38.927072 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 235/448] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:38 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:39.800570 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:39.801173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:39.803761 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:39.804445 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:39.809738 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:39.810294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:39.811051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:39.811504 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:39.941321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:39.943314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:39.944745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:39.950393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:39.950740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:39.951193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:39.951904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:39.952030 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:39.952371 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:39.953058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-12b53c23-b092-404b-b95a-e90bd4c32b36 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.156318 Jul 13 09:09:39.953615 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 214/449] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:39 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:39.973846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:40.086475 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:40.093904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-678b2af0-d085-4161-9168-2c8fdbd935c7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.154416 Jul 13 09:09:40.094500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 236/450] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:39 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:40.972590 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:40.973224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:40.980635 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:40.981072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:40.981823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:40.982285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:41.111415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:41.112041 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:41.116582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:41.118740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:41.119192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:41.119976 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:41.120429 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:41.125056 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:41.126588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:41.127760 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7914c765-79b6-475e-a854-333048532292 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.159135 Jul 13 09:09:41.128320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 215/451] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:40 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:41.252998 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:41.267463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6ecd76a9-0eb8-46b2-80a8-3e7079c6587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.158514 Jul 13 09:09:41.267463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 237/452] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:41 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:41.793620 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-6d0fd3cc-e2a6-4d95-893a-7ec26b869673 req-fa9e516e-44b0-431d-93da-6ae917a93310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "name": "network-vif-plugged", "status": "completed", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:41.801686 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-6d0fd3cc-e2a6-4d95-893a-7ec26b869673 req-fa9e516e-44b0-431d-93da-6ae917a93310 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:41.802213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-6d0fd3cc-e2a6-4d95-893a-7ec26b869673 req-fa9e516e-44b0-431d-93da-6ae917a93310 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:41.813667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-6d0fd3cc-e2a6-4d95-893a-7ec26b869673 req-fa9e516e-44b0-431d-93da-6ae917a93310 service nova] Creating event network-vif-plugged:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:09:41.818659 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-6d0fd3cc-e2a6-4d95-893a-7ec26b869673 req-fa9e516e-44b0-431d-93da-6ae917a93310 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028722 Jul 13 09:09:41.819303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 216/453] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:09:42.147728 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:42.148426 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:42.154737 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.155895 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.156422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.157054 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.160218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:42.266055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4e2e9255-8e02-4aaf-8cb3-d2725705bfd8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:42.273418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4e2e9255-8e02-4aaf-8cb3-d2725705bfd8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.273863 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4e2e9255-8e02-4aaf-8cb3-d2725705bfd8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.299146 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4e2e9255-8e02-4aaf-8cb3-d2725705bfd8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Going to try to stop instance {{(pid=118253) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 13 09:09:42.303273 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:42.317107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:42.317107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:42.317107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ae81b41c-a765-4eee-a442-8f3978f0f9a9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.172429 Jul 13 09:09:42.317365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 238/454] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:42 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:42.320298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:42.320783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:42.328468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.328468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.328468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.328468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.467507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:42.476115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5ca09c77-84f3-4016-bbad-c4851ab8b933 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.159495 Jul 13 09:09:42.477027 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 239/455] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:42 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:42.495120 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4e2e9255-8e02-4aaf-8cb3-d2725705bfd8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action" status: 202 len: 0 microversion: 2.1 time: 0.232992 Jul 13 09:09:42.498615 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 217/456] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:09:42 2022] POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:09:42.512745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:42.513365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:42.524338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.524338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.524338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:42.524338 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:42.669032 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:42.676622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ed6fb1e6-be3b-4393-a9d6-34cddd2a171c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.168880 Jul 13 09:09:42.677220 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 240/457] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:42 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:43.333842 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:43.335006 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:43.341260 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:43.341707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:43.342502 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:43.342937 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:43.472150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:43.481255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:43.482862 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:43.483997 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e43eebf7-b157-43fa-906a-3d06229c534e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.154851 Jul 13 09:09:43.484553 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 218/458] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:43 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:43.493593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:43.494247 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:43.500420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:43.500862 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:43.501616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:43.502056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:43.630514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:43.638401 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-56088e09-3185-43d7-b40a-2a8b5e89ef2b tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.149605 Jul 13 09:09:43.642631 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 241/459] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:43 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:43.694466 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:43.695009 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:43.700909 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:43.701354 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:43.702131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:43.702569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:43.830795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:43.839026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e8e8f7a4-c1a2-4e02-837e-cba34feff2ee tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.148619 Jul 13 09:09:43.839591 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 219/460] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:43 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:44.502998 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:44.503630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:44.510238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:44.510721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:44.511470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:44.511909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:44.656126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:44.657050 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:44.658825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:44.665906 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:44.666598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:44.672703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:44.672703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:44.672903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:44.672903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:44.673109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e88313f0-b96a-4798-b897-7e8c79fbcb17 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.173931 Jul 13 09:09:44.673591 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 242/461] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:44 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:09:44.811203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:44.819744 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8b7a896f-06f6-4bd3-923c-11291de5a457 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.167835 Jul 13 09:09:44.820397 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 220/462] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:44 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:44.856637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:44.857254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:44.863371 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:44.863823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:44.866179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:44.866179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:45.002266 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:45.010856 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fc39ddf1-a591-4453-bdd3-57695c208ec4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.158114 Jul 13 09:09:45.011418 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 243/463] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:44 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:45.690453 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:45.691060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:45.697828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:45.698306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:45.699065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:45.699496 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:45.827921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:45.837100 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:45.837628 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:45.837739 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:45.839058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:45.840381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-35c2ca6a-5456-463c-9b95-484696ec9145 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1808 microversion: 2.20 time: 0.153839 Jul 13 09:09:45.840939 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 221/464] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:45 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:45.843767 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:45.844284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:45.845489 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:45.846156 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:45.981376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:45.988980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cb725a33-f60d-478d-b427-09047bf50714 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.156189 Jul 13 09:09:45.989631 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 244/465] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:45 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:46.028051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:46.028730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:46.034810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:46.035268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:46.036132 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:46.036578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:46.169036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:46.176584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d8496439-4b34-449b-9f6f-89657520247d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.152429 Jul 13 09:09:46.177059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 222/466] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:46 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:46.859674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:46.860285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:46.866788 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:46.867246 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:46.867997 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:46.868428 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:47.011961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:47.012084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:47.012084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:47.012610 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:47.012873 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:47.014047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7fa078af-fd86-4208-a795-863537645794 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1795 microversion: 2.20 time: 0.158516 Jul 13 09:09:47.014601 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 245/467] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:09:46 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:09:47.016643 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:47.017127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:47.017904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:47.018495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:47.152115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:47.159446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3c44a574-3688-402e-9e35-72088bd17e53 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.156574 Jul 13 09:09:47.160014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 223/468] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:47 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:47.194097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:47.194740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:47.200757 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:47.201154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:47.201919 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:47.202383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:47.332746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:47.346277 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7db901b3-d451-4b78-abce-c8e22ebd7b65 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.156070 Jul 13 09:09:47.346937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 246/469] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:47 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:48.176666 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:48.177305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:48.180310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:48.185023 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:48.185464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:48.186253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:48.186696 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:48.324126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:48.332579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3f1405e9-8ab5-4102-9f76-79ad4fd7ea7e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.159683 Jul 13 09:09:48.333163 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 224/470] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:48 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:48.368137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:48.368794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:48.375615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:48.376147 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:48.376999 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:48.377438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:48.516252 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:48.524767 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a7b0cdae-3eb7-4009-91f6-a72908f2fa55 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.164359 Jul 13 09:09:48.525363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 247/471] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:48 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:49.045851 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:49.046909 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:49.053643 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.054045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.054824 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.055263 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.231682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7ea18a5d-c5b4-473f-95fc-fca190d694a7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/action" status: 202 len: 0 microversion: 2.1 time: 0.189449 Jul 13 09:09:49.232450 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 225/472] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:09:49 2022] POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:09:49.240568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:49.241189 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:49.247846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.248302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.249078 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.249517 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.349205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:49.349900 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:49.357448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.357890 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.358682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.359115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.411362 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:49.420231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1ab9d538-664e-4b85-915c-cf8dfecebe5f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1752 microversion: 2.1 time: 0.183713 Jul 13 09:09:49.420816 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 248/473] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:49 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:49.542603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:49.543197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:49.549384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.549836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.550665 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:49.551092 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:49.583281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:49.594007 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4753bca3-5f09-4609-a6d3-b4bea08e1533 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.248884 Jul 13 09:09:49.605267 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 226/474] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:49 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:49.702356 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:49.710372 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-19451a10-d7cd-43f6-a85a-25d1ab87c38f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.172375 Jul 13 09:09:49.714020 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 249/475] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:49 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:50.440027 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:50.440659 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:50.447341 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:50.448057 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:50.448409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:50.448852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:50.464241 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:50.605334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:50.611577 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:50.612237 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:50.613653 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-be20a73b-37e8-4e5a-b71b-c18e7eeac1dc tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.177994 Jul 13 09:09:50.614262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 227/476] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:50 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:50.619850 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:50.620417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:50.621101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:50.621721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:50.728753 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:50.729644 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:50.736114 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:50.736535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:50.737298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:50.737923 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:50.760590 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:50.768088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8f5f5fd8-82e4-46d3-ba05-a196293fe847 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.160282 Jul 13 09:09:50.768742 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 250/477] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:50 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:50.871880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:50.879308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-34dbd517-25fb-49c3-84aa-bb7070032137 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.154852 Jul 13 09:09:50.879868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 228/478] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:50 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:51.633173 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:51.633818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:51.640052 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.640503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.641259 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.641697 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.784841 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:51.785422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:51.785555 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:51.792976 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.795281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.795281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.795281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.795775 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5169aa4c-4d58-4522-856c-582efb06a68f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.166230 Jul 13 09:09:51.796369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 251/479] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:51 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:51.886310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-13371dd7-2d92-4c8e-a90e-6ff88b3731d8 req-80e02896-13e0-40a9-88d7-1bae95e55ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028cc5e6-e410-40e7-8327-d4dbe5b6c0d3", "name": "network-vif-plugged", "status": "completed", "tag": "41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:51.897080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-13371dd7-2d92-4c8e-a90e-6ff88b3731d8 req-80e02896-13e0-40a9-88d7-1bae95e55ffc service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.897529 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-13371dd7-2d92-4c8e-a90e-6ff88b3731d8 req-80e02896-13e0-40a9-88d7-1bae95e55ffc service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.909117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-13371dd7-2d92-4c8e-a90e-6ff88b3731d8 req-80e02896-13e0-40a9-88d7-1bae95e55ffc service nova] Creating event network-vif-plugged:41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d for instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 on hv-cinder-84962 Jul 13 09:09:51.914902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-13371dd7-2d92-4c8e-a90e-6ff88b3731d8 req-80e02896-13e0-40a9-88d7-1bae95e55ffc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033961 Jul 13 09:09:51.915512 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 252/480] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:09:51.920695 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:51.921392 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:51.933071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.933071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.933071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:51.933071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:51.937155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:51.950759 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fd939857-807c-41d4-aa3b-ebbc15d782c3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.169894 Jul 13 09:09:51.960274 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 229/481] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:51 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:52.071762 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:52.079630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e115de85-5e6f-4a34-9456-1da5964a5739 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1676 microversion: 2.1 time: 0.162852 Jul 13 09:09:52.080209 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 253/482] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:51 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:52.812699 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:52.814167 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:52.821829 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:52.822325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:52.823082 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:52.823514 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:52.967995 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:52.968617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:52.975008 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:52.975157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:52.975380 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:52.976631 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:52.977082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:52.983288 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1e97dc08-a702-4b0e-9d71-ab566db2b16e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.174417 Jul 13 09:09:52.983872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 230/483] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:52 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:53.097313 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:53.098026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:53.104872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:53.105391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:53.106259 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:53.106762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:53.110253 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:53.118861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2b362ad4-bc57-44d9-b686-3b0d721aa109 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.154835 Jul 13 09:09:53.119580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 254/484] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:52 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:53.240509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:53.249334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5e34f8ec-f645-410d-b640-0610f95d7894 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1653 microversion: 2.1 time: 0.156470 Jul 13 09:09:53.249917 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 231/485] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:53 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:53.266288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-752c938d-5bac-4eaa-8f2b-429d105faace tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:53.272498 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-752c938d-5bac-4eaa-8f2b-429d105faace tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:53.273459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-752c938d-5bac-4eaa-8f2b-429d105faace tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:53.287248 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:53.296559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-752c938d-5bac-4eaa-8f2b-429d105faace tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Going to try to start instance {{(pid=118252) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 13 09:09:53.493110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-752c938d-5bac-4eaa-8f2b-429d105faace tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action" status: 202 len: 0 microversion: 2.1 time: 0.230409 Jul 13 09:09:53.493699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 255/486] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:09:53 2022] POST /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:09:53.501876 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:53.502518 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:53.509106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:53.509788 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:53.511956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:53.512457 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:53.647287 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:53.655789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5b8e79ba-a666-4413-926e-31b82c97b4e5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1662 microversion: 2.1 time: 0.157837 Jul 13 09:09:53.656366 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 232/487] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:53 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:54.001207 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:54.001898 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:54.008792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:54.009231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:54.010307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:54.010763 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:54.136476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:54.137211 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:54.143500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:54.144039 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:54.144888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:54.145397 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:54.157305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:54.166158 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1a61e87f-6638-4017-b104-b7f38979781f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.169079 Jul 13 09:09:54.167097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 256/488] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:53 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:54.526369 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:54.533844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f12b48cb-901f-47b1-b7d4-ad99c30d9e9d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1266 microversion: 2.1 time: 0.402141 Jul 13 09:09:54.534455 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 233/489] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:54 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:54.672948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:54.673582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:54.681067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:54.681559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:54.682573 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:54.683010 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:54.821516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:54.830820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b06bf3f1-ad51-4924-8145-7e3f58f6333f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1662 microversion: 2.1 time: 0.161764 Jul 13 09:09:54.831402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 257/490] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:54 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:55.184520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:55.185131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:55.191676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.192124 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.192884 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.193326 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.335114 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:55.343513 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d8306700-b70e-4936-8ba6-1e3f9b1316a0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.163038 Jul 13 09:09:55.344086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 234/491] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:55 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:55.552256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:55.552867 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:55.559268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.559691 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.560455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.560883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.693202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:55.701013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-70cca02c-b5cd-440e-8038-7f2737450bec tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1452 microversion: 2.1 time: 0.153250 Jul 13 09:09:55.701585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 258/492] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:55 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:55.718594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:55.719210 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:55.725181 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.727020 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.727929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.728428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.853193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:55.854145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:55.860644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.861092 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.861880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:55.862348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:55.872072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:55.879893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-439ff8f3-d221-4170-a231-f7b055287067 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1452 microversion: 2.1 time: 0.165103 Jul 13 09:09:55.880813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 235/493] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:55 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:56.000515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:56.008678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6215d94d-3895-4810-97a3-4e2b15f87185 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1666 microversion: 2.1 time: 0.160335 Jul 13 09:09:56.009257 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 259/494] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:55 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:56.360650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:56.361275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:56.368882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:56.369339 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:56.370147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:56.370591 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:56.540775 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:56.549119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-aef0026a-e8e4-4e0f-8f97-66b49b8b59c0 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.192339 Jul 13 09:09:56.549905 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 236/495] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:56 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:57.567303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:57.568555 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:57.574988 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:57.575440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:57.576217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:57.576659 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:57.836649 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:57.845788 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7e1f08c3-28b9-4387-af56-8b7fd8b1c2d7 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.282664 Jul 13 09:09:57.846405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 260/496] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:57 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:09:58.241441 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-2a7f8fe6-40db-4d0b-ac2a-8bc50e77182d req-c1a26d1f-f45f-4c68-a579-10c23b0532a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028cc5e6-e410-40e7-8327-d4dbe5b6c0d3", "tag": "41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:58.251056 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2a7f8fe6-40db-4d0b-ac2a-8bc50e77182d req-c1a26d1f-f45f-4c68-a579-10c23b0532a5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:58.251504 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2a7f8fe6-40db-4d0b-ac2a-8bc50e77182d req-c1a26d1f-f45f-4c68-a579-10c23b0532a5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:58.266481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-2a7f8fe6-40db-4d0b-ac2a-8bc50e77182d req-c1a26d1f-f45f-4c68-a579-10c23b0532a5 service nova] Creating event network-changed:41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d for instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 on hv-cinder-84962 Jul 13 09:09:58.271693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-2a7f8fe6-40db-4d0b-ac2a-8bc50e77182d req-c1a26d1f-f45f-4c68-a579-10c23b0532a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033838 Jul 13 09:09:58.272567 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 237/497] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:09:58.864140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:09:58.864870 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:58.871261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:58.871787 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:58.872618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:58.873059 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:59.022217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:09:59.031347 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9ca276b9-c552-4449-aadd-71694bbf581e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.171275 Jul 13 09:09:59.031908 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 261/498] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:09:58 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:09:59.275937 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa237fb-79ad-4d12-88fb-518741d25ade"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:09:59.277155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:09:59.283802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:59.284245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:59.284994 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:09:59.285424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:09:59.997906 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4496dbc2-0e94-403f-85aa-75e4cf31d150 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726866 Jul 13 09:10:00.001566 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 238/499] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:09:59 2022] POST /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:00.053612 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:00.053612 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:00.055519 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:00.055973 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:00.056743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:00.057178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:00.207351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:00.216121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-923a0226-8e60-4761-bb7e-d6870475bf99 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.171362 Jul 13 09:10:00.216703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 262/500] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:00 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:01.234332 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:01.235027 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:01.241207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:01.241656 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:01.243093 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:01.243555 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:01.383681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:01.391883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d9a1bff6-90ca-45f8-9bdf-6ddb8e4e5052 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.162365 Jul 13 09:10:01.392449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 239/501] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:01 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:02.409179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:02.409794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:02.416528 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:02.416967 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:02.417726 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:02.418208 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:02.561578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:02.569443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b195827a-77b5-4420-99e3-0493f6a0d69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.164240 Jul 13 09:10:02.570006 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 263/502] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:02 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:03.588095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:03.588648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:03.595280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:03.595880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:03.596689 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:03.597125 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:03.738879 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:03.747357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-79314c85-1567-4d03-89f9-ac10bc753f2b tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.163931 Jul 13 09:10:03.747922 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 240/503] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:03 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:04.765157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:04.765775 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:04.771909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:04.772359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:04.773117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:04.773834 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:04.920253 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:04.928270 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b9b7cadb-3cd9-40df-bb7d-b8c759c4187e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.167016 Jul 13 09:10:04.928835 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 264/504] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:04 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:05.945682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:05.946462 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:05.952923 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:05.953478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:05.954261 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:05.954691 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:06.100178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:06.108381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4094ead4-3f9c-4faa-bb16-9ec236669610 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1757 microversion: 2.1 time: 0.166504 Jul 13 09:10:06.108951 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 241/505] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:05 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:07.125882 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:07.126527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:07.132750 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:07.137902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:07.137902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:07.137902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:07.276936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:07.284888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-db6bbe8d-6cf5-46a3-b1f3-e0e25f620415 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1760 microversion: 2.1 time: 0.162902 Jul 13 09:10:07.285454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 265/506] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:07 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:08.547161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:08.548118 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:08.554605 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:08.555054 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:08.555813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:08.556246 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:08.578991 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'flavor' on Instance uuid 4c84256c-3f8c-43e1-9c7d-2a433978a7bd {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:10:08.655042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:09.002169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cc5c65e5-9f28-4a6c-aa9d-65bbba73d784 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/action" status: 200 len: 32 microversion: 2.1 time: 0.459584 Jul 13 09:10:09.002902 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 242/507] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:10:08 2022] POST /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:10:09.012461 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:09.013074 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:09.015194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=68 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:09.019888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:09.020337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:09.027445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:09.027445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:09.154449 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:09.163107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cb5ce7e9-d858-45e0-a45a-2e2964a3176b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.155252 Jul 13 09:10:09.163741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 266/508] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:09 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:10.182184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:10.182808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:10.190806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:10.191394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:10.192248 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:10.192806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:10.327931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:10.336100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c1b790b5-0ed0-4cd6-a172-575367b86b0e tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.158860 Jul 13 09:10:10.336697 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 243/509] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:10 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:11.353931 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:11.354621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:11.361061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:11.361508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:11.362302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:11.362747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:11.490378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:11.498504 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-91564d6a-041b-46bc-a49a-ce3ae1db4280 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.148354 Jul 13 09:10:11.499070 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 267/510] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:11 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:12.516237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:12.516770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:12.523489 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:12.523935 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:12.524687 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:12.525129 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:12.651405 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:12.659931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e775a6c5-e9cb-408e-bf76-63ee85f271e4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.147580 Jul 13 09:10:12.660493 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 244/511] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:12 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:13.677660 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:13.678307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:13.685155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:13.685605 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:13.686398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:13.686833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:13.815591 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:13.823516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1e4a809f-5b38-4bb1-830d-c8f907e26754 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.149715 Jul 13 09:10:13.824111 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 268/512] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:13 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:14.841041 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:14.841641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:14.848176 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:14.848625 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:14.849383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:14.849817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:14.978698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:14.986574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b98c75bd-4d79-49b5-a3a1-1b4860b5384f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.149941 Jul 13 09:10:14.987135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 245/513] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:14 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:16.003579 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:16.004187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:16.010447 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:16.011480 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:16.012393 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:16.012833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:16.139531 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:16.147419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-17af2050-843c-4769-8036-426cec5b7676 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.147757 Jul 13 09:10:16.147986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 269/514] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:15 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:17.164376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:17.164982 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:17.172175 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:17.172628 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:17.173386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:17.173818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:17.298645 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:17.306414 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e5d20692-715b-4af5-b287-198d0200c22a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.145790 Jul 13 09:10:17.306977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 246/515] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:17 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:18.322318 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:18.322935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:18.329170 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:18.329618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:18.330410 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:18.330841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:18.456844 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:18.465627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8bd3267b-e661-4de0-a85b-963019f7a821 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.147137 Jul 13 09:10:18.466224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 270/516] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:18 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:19.483342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:19.483874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:19.486341 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=46 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:19.491060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:19.491500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:19.492252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:19.492678 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:19.625155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:19.633165 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-75d1178c-4cae-4e45-a805-f471bee424a8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.154305 Jul 13 09:10:19.633733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 247/517] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:19 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:20.650570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:20.651181 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:20.657853 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:20.658331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:20.659095 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:20.659530 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:20.662058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:20.792669 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:20.800723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3f2cb908-27a1-4dac-bd6f-0f53dce7e587 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.154048 Jul 13 09:10:20.801299 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 271/518] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:20 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:21.817817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:21.818485 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:21.825141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:21.825590 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:21.826393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:21.826832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:21.952486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:21.960312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6521063d-4ce5-4ecb-96ac-646fc48ec1a9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.146385 Jul 13 09:10:21.960880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 248/519] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:21 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:22.976605 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:22.977213 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:22.984154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:22.984604 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:22.985378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:22.985818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:23.113747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:23.121992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-163ab1e8-b975-4e70-b4fc-7b646563475c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.149222 Jul 13 09:10:23.122580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 272/520] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:22 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:24.139776 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:24.140431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:24.147003 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:24.147449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:24.148200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:24.148634 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:24.278345 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:24.286291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9ac9c6fc-4d0c-44be-9713-4b798d59232d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.150822 Jul 13 09:10:24.286866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 249/521] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:24 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:25.303044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:25.303650 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:25.309637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:25.310728 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:25.310906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:25.311349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:25.443806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:25.452131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-50add981-92df-420e-af8e-e39e1722765d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.152922 Jul 13 09:10:25.452703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 273/522] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:25 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:26.469791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:26.470367 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:26.477032 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:26.477478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:26.478492 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:26.478790 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:26.657941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:26.665989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-91d4ce45-eeed-4436-b809-92a3ec679208 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.200301 Jul 13 09:10:26.666627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 250/523] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:26 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:10:27.682262 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:27.683315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:27.689291 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:27.689720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:27.690593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:27.691025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:27.818402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:27.827728 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-af085b85-d33b-4b4c-ab9a-55dba1e28c98 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1736 microversion: 2.1 time: 0.149358 Jul 13 09:10:27.828307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 274/524] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:27 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:28.844819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:28.845359 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:28.851886 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:28.852334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:28.853130 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:28.853578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:28.981958 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:28.989915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2fa8eef9-5a19-4114-933e-22ddffffcbb9 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1716 microversion: 2.1 time: 0.149119 Jul 13 09:10:28.990501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 251/525] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:28 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:10:29.090787 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:29.091282 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:29.097289 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.097678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.098461 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.098894 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.222460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] HTTP exception thrown: Cannot 'detach_volume' instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd while it is in vm_state rescued Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Request method failure captured: Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments/baa237fb-79ad-4d12-88fb-518741d25ade HTTP/1.1 Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosJU0xdskOdcTptAE5bhES6v1ZUimaLvfQtrokc0q7dinMkfp__MPqxaPVSdCgw_F6U_orIDcszlTl8BAm8AtiKOkOz440nNWH1bnO3pwnp82VQ9w7CQLOR_PrGKqaVO0YkEnsPBshTjyu3jwLh2JygaCXrK4J-Yi1JWZz9D7TzlTI Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:10:29.224034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7afbdee349034d2182240f1f7230236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7afbdee349034d2182240f1f7230236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: d9bffb24cf26486a9a8947882b52ec98 Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:10:29.225462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Cannot 'detach_volume' instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd while it is in vm_state rescued Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'server_id': '4c84256c-3f8c-43e1-9c7d-2a433978a7bd', 'id': 'baa237fb-79ad-4d12-88fb-518741d25ade'} Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:10:29.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd while it is in vm_state rescued Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd while it is in vm_state rescued Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:29.228201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Returning 409 to user: Cannot 'detach_volume' instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd while it is in vm_state rescued {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:10:29.229238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e818c035-cfb5-44b9-9563-363968618f37 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments/baa237fb-79ad-4d12-88fb-518741d25ade" status: 409 len: 152 microversion: 2.1 time: 0.138760 Jul 13 09:10:29.229238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 275/526] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:10:29 2022] DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments/baa237fb-79ad-4d12-88fb-518741d25ade => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 13 09:10:29.234957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:29.235496 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:29.241510 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.241963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.242774 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.243202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.413075 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ff41c240-9a2b-4eff-acd2-76fffc6455c1 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "POST /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/action" status: 202 len: 0 microversion: 2.1 time: 0.181776 Jul 13 09:10:29.415106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 252/527] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:10:29 2022] POST /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:10:29.422675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:29.424079 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:29.430125 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.430573 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.431337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.431767 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.508059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:29.508723 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:29.515713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.516175 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.516938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.517384 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.549982 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5aa1b519-be40-429b-a439-4c35329c2ab5 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments/2763c97a-1365-44c7-99c1-431311e57a45" status: 200 len: 194 microversion: 2.20 time: 0.046329 Jul 13 09:10:29.550939 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 253/528] 10.222.0.40 () {60 vars in 1453 bytes} [Wed Jul 13 09:10:29 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments/2763c97a-1365-44c7-99c1-431311e57a45 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:10:29.571769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:29.579759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cc4b0f38-89f4-4d27-b457-e2909b9e70e2 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1724 microversion: 2.1 time: 0.160982 Jul 13 09:10:29.589958 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 276/529] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:29 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:29.617640 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:29.618170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:29.625575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.625575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.625833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.626581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.708842 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lazy-loading 'services' on Instance uuid f7bcc760-4b60-4bfc-bd63-33c070d886b6 {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:10:29.935731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9516328b-e5b3-4e33-bbfa-7673a804a6ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments/2763c97a-1365-44c7-99c1-431311e57a45" status: 202 len: 0 microversion: 2.20 time: 0.321781 Jul 13 09:10:29.936482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 254/530] 10.222.0.40 () {60 vars in 1456 bytes} [Wed Jul 13 09:10:29 2022] DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments/2763c97a-1365-44c7-99c1-431311e57a45 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:10:29.946320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:29.947496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:29.954097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.954556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.955804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:29.956087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:29.986312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0674848b-f437-46a8-8995-266b67febed0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Jul 13 09:10:29.986878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 277/531] 10.222.0.40 () {60 vars in 1342 bytes} [Wed Jul 13 09:10:29 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 09:10:30.597882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:30.598525 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:30.605496 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:30.606027 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:30.606819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:30.607332 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:30.747817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:30.759632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3a83ed4c-5026-43f8-a8fd-17eb8d170604 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1724 microversion: 2.1 time: 0.165754 Jul 13 09:10:30.760208 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 255/532] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:30 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:30.998363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:30.999280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:31.005481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:31.006082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:31.006849 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:31.007276 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:31.038142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5de76247-4749-4418-b973-18839cdd0bfc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044060 Jul 13 09:10:31.038697 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 278/533] 10.222.0.40 () {60 vars in 1342 bytes} [Wed Jul 13 09:10:30 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:10:31.778576 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:31.779184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:31.785578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:31.786023 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:31.786807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:31.787242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:31.802413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:31.922425 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:31.930214 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2d52cd2c-ecfd-4a96-8bb9-3b7f271f3db8 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1724 microversion: 2.1 time: 0.155470 Jul 13 09:10:31.930787 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 256/534] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:31 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:32.051896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:32.052736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:32.058778 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:32.059231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:32.059998 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:32.060441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:32.089874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-aa8194d2-d81b-4763-9fe4-5398a3313b8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042402 Jul 13 09:10:32.090521 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 279/535] 10.222.0.40 () {60 vars in 1342 bytes} [Wed Jul 13 09:10:32 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:10:32.947321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:32.947929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:32.954391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:32.954840 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:32.955607 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:32.956043 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.085537 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:33.093534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3e915158-10f9-4323-90fe-cead92bf603d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1730 microversion: 2.1 time: 0.150014 Jul 13 09:10:33.094127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 257/536] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:32 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:33.100904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:33.103813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:33.108677 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.109126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.109996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.110409 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.111080 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:33.111573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:33.117541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.117996 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.118795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.119238 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.141582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9e34be5c-e266-442a-897b-10708d85e817 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044599 Jul 13 09:10:33.142176 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 280/537] 10.222.0.40 () {60 vars in 1342 bytes} [Wed Jul 13 09:10:33 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:33.199962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e904dc26-86a7-4d7e-a189-1bc6f1a2dbda tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092743 Jul 13 09:10:33.200610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 258/538] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:10:33 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:10:33.201024 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:33.201596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:33.207697 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.208144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.208911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.209341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.235250 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:10:33.547175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-673877c2-7237-4a62-9c30-8940c343c0e9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 204 len: 0 microversion: 2.20 time: 0.349775 Jul 13 09:10:33.547696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 281/539] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Jul 13 09:10:33 2022] DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 13 09:10:33.556090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:33.556730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:33.563153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.563590 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.564370 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:33.564807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:33.871252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:33.879262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:33.880784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:33.881939 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-575db0ab-4b10-4dac-83c9-c3871f1afc86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.329793 Jul 13 09:10:33.882533 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 259/540] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:33 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:10:34.584217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-fe670eb3-c5dd-4cd2-914b-1cebaf24a58e req-dc8edbea-4417-4d13-86d4-364fe55fe70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84256c-3f8c-43e1-9c7d-2a433978a7bd", "tag": "5e405f48-99d1-4184-bb1c-d187e2f9e912"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:34.592493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-fe670eb3-c5dd-4cd2-914b-1cebaf24a58e req-dc8edbea-4417-4d13-86d4-364fe55fe70d service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:34.592935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-fe670eb3-c5dd-4cd2-914b-1cebaf24a58e req-dc8edbea-4417-4d13-86d4-364fe55fe70d service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:34.604120 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-fe670eb3-c5dd-4cd2-914b-1cebaf24a58e req-dc8edbea-4417-4d13-86d4-364fe55fe70d service nova] Creating event network-changed:5e405f48-99d1-4184-bb1c-d187e2f9e912 for instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd on hv-cinder-84962 Jul 13 09:10:34.609534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-fe670eb3-c5dd-4cd2-914b-1cebaf24a58e req-dc8edbea-4417-4d13-86d4-364fe55fe70d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029250 Jul 13 09:10:34.610143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 282/541] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:34.900660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:34.901306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:34.908639 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:34.909088 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:34.909854 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:34.910454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:35.043442 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:35.051534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:35.053060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:35.054249 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-35bdadd9-35fd-407b-9030-f1f5d79ece94 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.157434 Jul 13 09:10:35.054808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 260/542] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:34 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:36.073753 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:36.074447 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:36.080943 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:36.081387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:36.082203 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:36.082642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:36.220692 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:36.228674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:36.230785 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:36.231954 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ec6740f9-ba8e-4ba9-b47a-11bf19c37680 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1723 microversion: 2.20 time: 0.163121 Jul 13 09:10:36.232754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 283/543] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:36 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:36.640024 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-d85510ac-5b87-461b-931d-59e6d3086c77 req-8da97680-adca-4d0f-8469-cdd764e09137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84256c-3f8c-43e1-9c7d-2a433978a7bd", "tag": "5e405f48-99d1-4184-bb1c-d187e2f9e912"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:36.648599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d85510ac-5b87-461b-931d-59e6d3086c77 req-8da97680-adca-4d0f-8469-cdd764e09137 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:36.656316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d85510ac-5b87-461b-931d-59e6d3086c77 req-8da97680-adca-4d0f-8469-cdd764e09137 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:36.660967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-d85510ac-5b87-461b-931d-59e6d3086c77 req-8da97680-adca-4d0f-8469-cdd764e09137 service nova] Creating event network-changed:5e405f48-99d1-4184-bb1c-d187e2f9e912 for instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd on hv-cinder-84962 Jul 13 09:10:36.665985 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-d85510ac-5b87-461b-931d-59e6d3086c77 req-8da97680-adca-4d0f-8469-cdd764e09137 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031234 Jul 13 09:10:36.666660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 261/544] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:37.250548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:37.251160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:37.257534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:37.257982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:37.260167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:37.260612 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:37.293081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:37.293549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:37.294071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lazy-loading 'fault' on Instance uuid f7bcc760-4b60-4bfc-bd63-33c070d886b6 {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:10:37.340401 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:37.349297 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:37.351117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:37.352292 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f73829f4-4860-4511-8585-bc360fe6ef8d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 200 len: 1371 microversion: 2.20 time: 0.106003 Jul 13 09:10:37.353545 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 284/545] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:37 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:38.372437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:38.373124 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:38.379608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:38.380051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:38.380806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:38.381234 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:38.394833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] HTTP exception thrown: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Request method failure captured: Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 HTTP/1.1 Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor-c4aVWqTR_Kcr2AJOrmmYofeY56lR7VDgGrPNrySk-FP6yG84zWLt1IVDw6JJ2VJ2pf_JGTP4XarrfpQKjVKaVVvZ-tunisyLiN0eKtUSGTgVUyZNOv5MAWOenknszs3Wo8Z3q-nCef4g_548_hgS1s_pjeA0DUZxeBtlJOBaGWs Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:10:38.396464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 1438ef91441f4493844a915ce12fcfa4 Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:10:38.398151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'f7bcc760-4b60-4bfc-bd63-33c070d886b6'} Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:10:38.398988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:10:38.400377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:38.402068 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Returning 404 to user: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:10:38.402068 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-88814fef-0940-4d5e-aa8f-884d582949d4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 404 len: 111 microversion: 2.20 time: 0.030478 Jul 13 09:10:38.402068 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 262/546] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:38 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:10:38.407053 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bd59d081-add8-4a51-bdce-70fe36720413 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '.version_select at 0x7fad21a12e50>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:38.480244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bd59d081-add8-4a51-bdce-70fe36720413 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777032774" status: 204 len: 0 microversion: 2.20 time: 0.076308 Jul 13 09:10:38.481012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 285/547] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Jul 13 09:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777032774 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 13 09:10:38.688481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-64df9e06-9a57-44c5-ae93-c63509151ffe req-227b2591-3bb7-4e69-a1d3-237e99da2d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bcc760-4b60-4bfc-bd63-33c070d886b6", "name": "network-vif-deleted", "tag": "80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:38.697928 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-64df9e06-9a57-44c5-ae93-c63509151ffe req-227b2591-3bb7-4e69-a1d3-237e99da2d0e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:38.699732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-64df9e06-9a57-44c5-ae93-c63509151ffe req-227b2591-3bb7-4e69-a1d3-237e99da2d0e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:38.711433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-64df9e06-9a57-44c5-ae93-c63509151ffe req-227b2591-3bb7-4e69-a1d3-237e99da2d0e service nova] Creating event network-vif-deleted:80dacffe-3c6c-40f1-bfe7-4f46db2a6d3f for instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 on hv-cinder-84962 Jul 13 09:10:38.718183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-64df9e06-9a57-44c5-ae93-c63509151ffe req-227b2591-3bb7-4e69-a1d3-237e99da2d0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033728 Jul 13 09:10:38.719145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 263/548] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:10:39.254234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-33ade842-c302-40ff-9305-26ce54dea3e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'create', calling method: .version_select at 0x7fad21a92160>, body: {"keypair": {"name": "tempest-keypair-1156304271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRQFCqivne1XUfau1+x25F7zYx6vSG9IZnWZ8COr7exOpMS19ty43BshuuTS+vqn8nFvG6ifRfnd3Lurw83Af8vd1FZKz+4rAFvpH7JzpZ/GMhAnHBaljMXTMEyk+tONQ=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:39.269574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-33ade842-c302-40ff-9305-26ce54dea3e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:10:39.273734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-33ade842-c302-40ff-9305-26ce54dea3e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for user 1438ef91441f4493844a915ce12fcfa4 and project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:10:39.359905 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-33ade842-c302-40ff-9305-26ce54dea3e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.109652 Jul 13 09:10:39.360554 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 286/549] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Jul 13 09:10:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 13 09:10:41.543399 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1007517504", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dced4119-fd64-48f2-a32b-f0864c860758"}], "security_groups": [{"name": "tempest-securitygroup--478101958"}], "key_name": "tempest-keypair-1156304271", "user_data": "}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:41.648134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] validate_networks() for [('dced4119-fd64-48f2-a32b-f0864c860758', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:10:42.010760 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:10:42.011306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:10:42.011782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:10:42.012190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:10:42.012758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:10:42.021635 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:42.022110 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:42.022916 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:42.023352 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:42.040333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:10:42.045474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Getting quotas for user 1438ef91441f4493844a915ce12fcfa4 and project 09b63eccabbc498cb96dd4bbcef0969a. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:10:42.056261 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:10:42.059263 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:10:42.177804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5a1bf1e0-6960-4282-b9c5-9e0963b694c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.639862 Jul 13 09:10:42.178506 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 264/550] 10.222.0.40 () {62 vars in 1187 bytes} [Wed Jul 13 09:10:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 13 09:10:42.189608 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b559f92e-8d79-421e-b676-6624afdd13d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:42.190665 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b559f92e-8d79-421e-b676-6624afdd13d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:42.192693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:42.460686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b559f92e-8d79-421e-b676-6624afdd13d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:42.468468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b559f92e-8d79-421e-b676-6624afdd13d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:42.469982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b559f92e-8d79-421e-b676-6624afdd13d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:42.471234 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b559f92e-8d79-421e-b676-6624afdd13d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1282 microversion: 2.20 time: 0.285773 Jul 13 09:10:42.471775 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 287/551] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:42 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:10:43.489808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:43.490392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:43.497951 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:43.498424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:43.499277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:43.499608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:43.561306 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:43.569184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:43.570750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:43.571832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cfc66b11-41a0-414a-846c-c7930f12aa79 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1334 microversion: 2.20 time: 0.085991 Jul 13 09:10:43.572383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 265/552] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:43 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:44.589799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:44.590445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:44.596541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:44.596930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:44.597715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:44.598176 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:44.742837 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:44.753487 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:44.755230 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:44.756397 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ba1c5296-3f96-42ea-9b05-6fefa0033510 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.170524 Jul 13 09:10:44.756965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 288/553] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:44 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:45.507049 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-d5ac1268-72e7-4adc-b2ab-e46a6472286d req-4634d2fb-791e-45f9-9294-453663b8f6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:45.517069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d5ac1268-72e7-4adc-b2ab-e46a6472286d req-4634d2fb-791e-45f9-9294-453663b8f6c0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:45.517513 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d5ac1268-72e7-4adc-b2ab-e46a6472286d req-4634d2fb-791e-45f9-9294-453663b8f6c0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:45.528857 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-d5ac1268-72e7-4adc-b2ab-e46a6472286d req-4634d2fb-791e-45f9-9294-453663b8f6c0 service nova] Creating event network-changed:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:10:45.534989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-d5ac1268-72e7-4adc-b2ab-e46a6472286d req-4634d2fb-791e-45f9-9294-453663b8f6c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031027 Jul 13 09:10:45.538999 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 266/554] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:45.776003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:45.777313 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:45.783548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:45.783991 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:45.784745 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:45.785171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:45.800027 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:45.917754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:45.925283 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:45.926810 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:45.927906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-152ebc0d-cb25-4d04-af51-b1dac8a6b2d0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.155857 Jul 13 09:10:45.928461 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 289/555] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:45 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:46.946120 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:46.946816 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:46.953164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:46.953596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:46.954386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:46.954824 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:47.084867 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:47.093187 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:47.094733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:47.095817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dde12a30-bda7-4fe2-8e64-e8a1c4dc7bbe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.154383 Jul 13 09:10:47.096371 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 267/556] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:46 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:48.113960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:48.114680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:48.121276 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:48.122879 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:48.122879 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:48.123130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:48.257125 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:48.265475 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:48.267144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:48.268250 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c0706e70-c784-4c36-825a-0a549b4cf394 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.158271 Jul 13 09:10:48.268810 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 290/557] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:48 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:49.230628 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1262489158"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:49.231220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:49.237558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:49.238001 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:49.238789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:49.239252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:49.286564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:49.287177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:49.293353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:49.293796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:49.294584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:49.295018 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:49.366277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.network.security_group_api [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Removing security group d530a976-4a4c-4f30-adae-2bc85cfa2b96 from port 85a58c92-11ad-4ae8-b43c-cd72f892cc97 Jul 13 09:10:49.436244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:49.444731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:49.446274 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:49.447822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-41643d24-0938-4444-84c1-187611a4c9de tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.164645 Jul 13 09:10:49.457462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 291/558] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:49 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:49.781413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7634efb7-64c4-446c-bed3-6acb4ff1cc08 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/action" status: 202 len: 0 microversion: 2.1 time: 0.554660 Jul 13 09:10:49.782849 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 268/559] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:10:49 2022] POST /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:10:49.794396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-8f568a45-8ffe-4ff4-a610-3c1e7751d28e req-ca0045a1-d4db-45cb-a88d-41a938cd3aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:49.806256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-8f568a45-8ffe-4ff4-a610-3c1e7751d28e req-ca0045a1-d4db-45cb-a88d-41a938cd3aa6 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:49.807063 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-8f568a45-8ffe-4ff4-a610-3c1e7751d28e req-ca0045a1-d4db-45cb-a88d-41a938cd3aa6 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:49.822144 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-8f568a45-8ffe-4ff4-a610-3c1e7751d28e req-ca0045a1-d4db-45cb-a88d-41a938cd3aa6 service nova] Creating event network-changed:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:10:49.828992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-8f568a45-8ffe-4ff4-a610-3c1e7751d28e req-ca0045a1-d4db-45cb-a88d-41a938cd3aa6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043190 Jul 13 09:10:49.830287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 292/560] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:50.321049 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-959ff28c-c469-4941-8a96-d7ef8357192c req-840ae798-3147-4040-8806-49a0811e81ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "name": "network-vif-plugged", "status": "completed", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:50.329079 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:50.331516 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-959ff28c-c469-4941-8a96-d7ef8357192c req-840ae798-3147-4040-8806-49a0811e81ed service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:50.332215 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-959ff28c-c469-4941-8a96-d7ef8357192c req-840ae798-3147-4040-8806-49a0811e81ed service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:50.347459 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-959ff28c-c469-4941-8a96-d7ef8357192c req-840ae798-3147-4040-8806-49a0811e81ed service nova] Creating event network-vif-plugged:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:10:50.353643 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-959ff28c-c469-4941-8a96-d7ef8357192c req-840ae798-3147-4040-8806-49a0811e81ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036519 Jul 13 09:10:50.355462 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 269/561] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:50.466286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:50.466992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:50.484869 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:50.485327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:50.486146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:50.486583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:50.701670 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:50.709693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:50.711211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:50.712384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-aa87d4d9-ee93-4344-a578-8038a09860b0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.250693 Jul 13 09:10:50.712941 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 293/562] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:50 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:51.202964 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:51.203670 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:51.204062 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-17a35a1c-6cf5-4983-a646-42db01e868d3 req-2ae583b7-488b-4515-ade6-3aabe6c50aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:51.211085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.214444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.214568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-17a35a1c-6cf5-4983-a646-42db01e868d3 req-2ae583b7-488b-4515-ade6-3aabe6c50aad service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.214689 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.214787 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-17a35a1c-6cf5-4983-a646-42db01e868d3 req-2ae583b7-488b-4515-ade6-3aabe6c50aad service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.214878 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.224662 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-17a35a1c-6cf5-4983-a646-42db01e868d3 req-2ae583b7-488b-4515-ade6-3aabe6c50aad service nova] Creating event network-changed:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:10:51.230458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-17a35a1c-6cf5-4983-a646-42db01e868d3 req-2ae583b7-488b-4515-ade6-3aabe6c50aad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029429 Jul 13 09:10:51.231647 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 294/563] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:10:51.295737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lazy-loading 'services' on Instance uuid 7fab6a94-5644-4551-9434-0451849be88b {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:10:51.494154 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-08e5283a-5f61-4703-95c8-d7898cfdc69e tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments/e2ddbb45-dba9-40d3-8364-049b30b8c370" status: 202 len: 0 microversion: 2.1 time: 0.295732 Jul 13 09:10:51.494813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 270/564] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:10:51 2022] DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments/e2ddbb45-dba9-40d3-8364-049b30b8c370 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:10:51.503591 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:51.504654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:51.511184 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.511905 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.512718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.513152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.543774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a5885a2f-f1f0-4374-b5ac-2b8d70b9dedd tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Jul 13 09:10:51.544441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 295/565] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:10:51 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:10:51.731408 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:51.732109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:51.738372 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.738823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.739624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:51.740094 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:51.876955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:51.886331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:51.887924 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:51.889037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a6cfdb92-34ca-4bba-8104-b0c85b4609e1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1407 microversion: 2.20 time: 0.161942 Jul 13 09:10:51.889627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 271/566] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:51 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:52.555432 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:52.556352 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:52.558343 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:52.563816 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:52.564255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:52.565045 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:52.565491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:52.593927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-aa3056ba-68a9-4b45-aded-8151d62e0e3f tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Jul 13 09:10:52.594526 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 296/567] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:10:52 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:52.907607 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:52.908221 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:52.910327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:52.910999 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:52.916239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:52.916693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:52.917532 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:52.917974 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.053103 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:53.061634 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:53.063282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:53.064427 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-86983d7f-53e6-4c1e-a0c4-3b5fec0d59f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1599 microversion: 2.20 time: 0.160912 Jul 13 09:10:53.067314 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 272/568] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:10:52 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:10:53.082618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:53.083114 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:53.089305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:53.089755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.091097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:53.091539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.173211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6f26fcb9-fff2-4518-aa61-ec39be9f68a6 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095048 Jul 13 09:10:53.173865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 297/569] 10.222.0.40 () {60 vars in 1315 bytes} [Wed Jul 13 09:10:53 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:10:53.605648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:53.606755 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:53.612844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:53.613298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.614090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:53.614535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.644041 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9b17df07-9393-4b92-8632-846ebb4fd545 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042877 Jul 13 09:10:53.644610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 273/570] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:10:53 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:10:53.654405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:53.655031 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:53.661052 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:53.661501 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.662284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:53.662717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:53.735794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] HTTP exception thrown: Instance 7fab6a94-5644-4551-9434-0451849be88b is not attached to volume e2ddbb45-dba9-40d3-8364-049b30b8c370 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Request method failure captured: Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments/e2ddbb45-dba9-40d3-8364-049b30b8c370 HTTP/1.1 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizotnwaXN35FcwVEqPFsnqDkKjv7Tx9DpwVUsV3uQIK8z36fAN2llyxX7uzqCvlzxRS6QMv8Iw2EtMsK6X1_ecBJL9xGLGeysW7abUxEYi1oU_hdVW-En9RMyNXETxJN6sCiAHcjcy660xW3azl1KtR_wHLgEyVulHkW9TKGBor1B70Q Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: be3ff54edaf7439bab9ca81656e94c70 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-TestMinimumBasicScenario-948588035 Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:10:53.738217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-TestMinimumBasicScenario-948588035 Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: be3ff54edaf7439bab9ca81656e94c70 Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-TestMinimumBasicScenario-948588035 Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-TestMinimumBasicScenario-948588035-project Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 1ac8c3e3e99e412bb4a1f7b1506abce2 Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-TestMinimumBasicScenario-948588035-project Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:10:53.739760 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 7fab6a94-5644-4551-9434-0451849be88b is not attached to volume e2ddbb45-dba9-40d3-8364-049b30b8c370 Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'server_id': '7fab6a94-5644-4551-9434-0451849be88b', 'id': 'e2ddbb45-dba9-40d3-8364-049b30b8c370'} Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e2ddbb45-dba9-40d3-8364-049b30b8c370. Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:10:53.743795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fab6a94-5644-4551-9434-0451849be88b is not attached to volume e2ddbb45-dba9-40d3-8364-049b30b8c370 Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fab6a94-5644-4551-9434-0451849be88b is not attached to volume e2ddbb45-dba9-40d3-8364-049b30b8c370 Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:10:53.745168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Returning 404 to user: Instance 7fab6a94-5644-4551-9434-0451849be88b is not attached to volume e2ddbb45-dba9-40d3-8364-049b30b8c370 {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:10:53.747019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c5ad787b-0125-4649-b00b-68c3be4aea6c tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments/e2ddbb45-dba9-40d3-8364-049b30b8c370" status: 404 len: 154 microversion: 2.1 time: 0.089354 Jul 13 09:10:53.747019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 298/571] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:10:53 2022] DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b/os-volume_attachments/e2ddbb45-dba9-40d3-8364-049b30b8c370 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:10:54.144656 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-45077fa0-d86c-457e-9a4c-8804f7b8c244 req-175f53d8-8174-4895-8280-1d4c59cfd3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:54.154005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-45077fa0-d86c-457e-9a4c-8804f7b8c244 req-175f53d8-8174-4895-8280-1d4c59cfd3dd service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:54.154481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-45077fa0-d86c-457e-9a4c-8804f7b8c244 req-175f53d8-8174-4895-8280-1d4c59cfd3dd service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:54.167342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-45077fa0-d86c-457e-9a4c-8804f7b8c244 req-175f53d8-8174-4895-8280-1d4c59cfd3dd service nova] Creating event network-changed:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:10:54.173609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-45077fa0-d86c-457e-9a4c-8804f7b8c244 req-175f53d8-8174-4895-8280-1d4c59cfd3dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033303 Jul 13 09:10:54.174177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 274/572] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:55.004278 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:55.004796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:55.011298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:55.011749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:55.013145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:55.013578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:55.039325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:10:55.289593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-30f39eb9-01fe-4e4b-9f9b-98b9d487ce11 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 204 len: 0 microversion: 2.1 time: 0.288760 Jul 13 09:10:55.290270 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 299/573] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:10:54 2022] DELETE /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:10:55.299509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:55.300213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:55.306446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:55.306894 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:55.307653 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:55.308086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:55.444196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:55.451679 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7a74838c-461c-43e4-ba7d-4c59b1647b84 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1554 microversion: 2.1 time: 0.156816 Jul 13 09:10:55.459523 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 275/574] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:55 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:10:56.470313 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:56.470994 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:56.477018 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:56.477462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:56.478235 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:56.478664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:56.606879 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:56.614900 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5648925a-899f-4681-b051-25c8153a6c62 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1554 microversion: 2.1 time: 0.148838 Jul 13 09:10:56.615476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 300/575] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:56 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:57.548409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-9b354f07-59e5-4590-98ed-688e65d18a70 req-9faebb57-656d-40f1-a2f7-a03962e8b68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fab6a94-5644-4551-9434-0451849be88b", "name": "network-vif-deleted", "tag": "85a58c92-11ad-4ae8-b43c-cd72f892cc97"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:10:57.556990 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-9b354f07-59e5-4590-98ed-688e65d18a70 req-9faebb57-656d-40f1-a2f7-a03962e8b68d service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:57.557435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-9b354f07-59e5-4590-98ed-688e65d18a70 req-9faebb57-656d-40f1-a2f7-a03962e8b68d service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:57.570744 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-9b354f07-59e5-4590-98ed-688e65d18a70 req-9faebb57-656d-40f1-a2f7-a03962e8b68d service nova] Creating event network-vif-deleted:85a58c92-11ad-4ae8-b43c-cd72f892cc97 for instance 7fab6a94-5644-4551-9434-0451849be88b on hv-cinder-84962 Jul 13 09:10:57.576757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-9b354f07-59e5-4590-98ed-688e65d18a70 req-9faebb57-656d-40f1-a2f7-a03962e8b68d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Jul 13 09:10:57.577382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 276/576] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:10:57.633087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:57.633609 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:57.640517 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:57.640986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:57.641730 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:57.642196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:57.703978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8c3e3e99e412bb4a1f7b1506abce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3ff54edaf7439bab9ca81656e94c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:57.711613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-324b4cb2-d75d-4994-a0a2-48ff1776d330 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 200 len: 1512 microversion: 2.1 time: 0.082483 Jul 13 09:10:57.712177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 301/577] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:57 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:10:58.733710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:58.734424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] [instance: 7fab6a94-5644-4551-9434-0451849be88b] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:58.740609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:58.741049 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:58.741796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:58.742253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:58.755645 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] HTTP exception thrown: Instance 7fab6a94-5644-4551-9434-0451849be88b could not be found. Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Request method failure captured: Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b HTTP/1.1 Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizotnwaXN35FcwVEqPFsnqDkKjv7Tx9DpwVUsV3uQIK8z36fAN2llyxX7uzqCvlzxRS6QMv8Iw2EtMsK6X1_ecBJL9xGLGeysW7abUxEYi1oU_hdVW-En9RMyNXETxJN6sCiAHcjcy660xW3azl1KtR_wHLgEyVulHkW9TKGBor1B70Q Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: be3ff54edaf7439bab9ca81656e94c70 Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-TestMinimumBasicScenario-948588035 Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:10:58.757224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be3ff54edaf7439bab9ca81656e94c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-TestMinimumBasicScenario-948588035 Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: be3ff54edaf7439bab9ca81656e94c70 Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-TestMinimumBasicScenario-948588035 Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-TestMinimumBasicScenario-948588035-project Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 1ac8c3e3e99e412bb4a1f7b1506abce2 Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-TestMinimumBasicScenario-948588035-project Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 7fab6a94-5644-4551-9434-0451849be88b could not be found. Jul 13 09:10:58.758809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '7fab6a94-5644-4551-9434-0451849be88b'} Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fab6a94-5644-4551-9434-0451849be88b could not be found. Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:10:58.759915 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fab6a94-5644-4551-9434-0451849be88b could not be found. Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fab6a94-5644-4551-9434-0451849be88b could not be found. Jul 13 09:10:58.761400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:10:58.763501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Returning 404 to user: Instance 7fab6a94-5644-4551-9434-0451849be88b could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:10:58.763501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cc008ad4-84fa-4103-822b-508363d60f41 tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b" status: 404 len: 111 microversion: 2.1 time: 0.029901 Jul 13 09:10:58.763501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 277/578] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:58 2022] GET /compute/v2.1/servers/7fab6a94-5644-4551-9434-0451849be88b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:10:58.768422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fd59b73d-be80-43ce-afe3-7c31328e704d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] Calling method '.version_select at 0x7fad21a0f430>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:58.885026 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fd59b73d-be80-43ce-afe3-7c31328e704d tempest-TestMinimumBasicScenario-948588035 tempest-TestMinimumBasicScenario-948588035-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1693585511" status: 202 len: 0 microversion: 2.1 time: 0.120310 Jul 13 09:10:58.885679 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 302/579] 10.222.0.40 () {58 vars in 1271 bytes} [Wed Jul 13 09:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1693585511 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:10:59.218749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:59.219752 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:59.225780 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:59.226271 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:59.227039 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:59.227517 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:59.258237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5eed2abe-d04a-4556-b0de-d411c53ad080 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043504 Jul 13 09:10:59.258644 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 278/580] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:10:59 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:10:59.319875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:59.320362 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:59.326801 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:59.327315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:59.328254 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:59.328691 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:59.356929 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:10:59.581072 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c645eb13-2fd1-48a5-83ac-e97dc37c268b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 204 len: 0 microversion: 2.1 time: 0.264769 Jul 13 09:10:59.581674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 303/581] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:10:59 2022] DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:10:59.589757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:10:59.590945 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:10:59.596955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:59.597594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:59.598594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:10:59.599269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:10:59.603477 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:10:59.733313 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:10:59.741528 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e4ecedf2-24aa-4560-bcdc-ffef95d58fdb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1672 microversion: 2.1 time: 0.155592 Jul 13 09:10:59.742107 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 279/582] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:10:59 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:00.759630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:00.760358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:00.766965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:00.767415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:00.768187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:00.768618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:00.969466 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:00.977192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-06fab999-9626-493a-b256-c0e78c681f33 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1672 microversion: 2.1 time: 0.222158 Jul 13 09:11:00.977846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 304/583] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:00 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1672 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:01.994968 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:02.001089 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:02.017668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:02.018736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:02.019698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:02.020715 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:02.391701 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:02.399187 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d4fdb7c8-8eb8-48b0-bbf2-2bde99256f45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1605 microversion: 2.1 time: 0.408012 Jul 13 09:11:02.399757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 280/584] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:01 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1605 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:02.504120 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-afee67b8-7da0-486f-8648-f2a8f12bfee1 req-9756f39f-204b-4b3f-894e-6228d009baca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4e5e88-6062-46c0-92b1-4f21fe81b697", "name": "network-vif-deleted", "tag": "97786c99-fd64-4d30-a6bd-7dffa045cb11"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:02.514080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-afee67b8-7da0-486f-8648-f2a8f12bfee1 req-9756f39f-204b-4b3f-894e-6228d009baca service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:02.514778 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-afee67b8-7da0-486f-8648-f2a8f12bfee1 req-9756f39f-204b-4b3f-894e-6228d009baca service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:02.527791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-afee67b8-7da0-486f-8648-f2a8f12bfee1 req-9756f39f-204b-4b3f-894e-6228d009baca service nova] Creating event network-vif-deleted:97786c99-fd64-4d30-a6bd-7dffa045cb11 for instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 on hv-cinder-84962 Jul 13 09:11:02.534811 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-afee67b8-7da0-486f-8648-f2a8f12bfee1 req-9756f39f-204b-4b3f-894e-6228d009baca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034342 Jul 13 09:11:02.535813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 305/585] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:11:03.416781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:03.417434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:03.424018 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:03.434277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:03.434277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:03.434277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:03.472240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:03.472900 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:03.473689 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lazy-loading 'fault' on Instance uuid eb4e5e88-6062-46c0-92b1-4f21fe81b697 {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:11:03.531711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:03.540900 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-acfaa979-e27c-4d3d-8e31-0244fbe26f94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 200 len: 1326 microversion: 2.1 time: 0.127864 Jul 13 09:11:03.554874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 281/586] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:03 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:04.560850 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:04.561577 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:04.567751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:04.568184 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:04.568942 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:04.569372 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:04.572013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:04.583330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] HTTP exception thrown: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Request method failure captured: Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 HTTP/1.1 Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosJL14-Jd669uQ93xCI7Dipg0q3d_SI8GbbqXCrnO-92r1NSd_dpIBEOOMIXGFAPlyc2TevoLVY2e76wfW64RgXFbyIBtpeox706MdRT-gZx1WF09i1UqCJ-35MG67L35BgpdyUSCPkP59078aWJbbxEjsy1YcLYnWKMwGe7Umf0Xk Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:11:04.584971 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 35c7c83855084c188ab8a6dacb57a24b Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:11:04.586629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'eb4e5e88-6062-46c0-92b1-4f21fe81b697'} Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:11:04.591101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:11:04.592364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:04.593606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Returning 404 to user: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:11:04.593606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7ce429c0-d995-40bb-a984-d472b5e39108 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 404 len: 111 microversion: 2.1 time: 0.030545 Jul 13 09:11:04.593606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 306/587] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:04 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:11:04.595719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0d92a13a-6205-4f91-8cdb-a07d9cd69d94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '.version_select at 0x7fad218d7160>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:04.650432 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0d92a13a-6205-4f91-8cdb-a07d9cd69d94 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943858323" status: 202 len: 0 microversion: 2.1 time: 0.058638 Jul 13 09:11:04.651033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 282/588] 10.222.0.40 () {58 vars in 1217 bytes} [Wed Jul 13 09:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943858323 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:11:05.760734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-52f90da1-a215-4723-b235-4a011313a605 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: .version_select at 0x7fad2199f8b0>, body: {"keypair": {"name": "tempest-keypair-2003080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsyNrOmZRxB1JXXDwqNFNyrIzAKqIogMHxBn4Xb6tlKQXD89dvjzFl+MsrEU0ev9JArJ43LgWUX8drs9Ya4T2b4l1aiczfctwWqVUuJYscXePr/FR6wF7FRRNxcwLMalg=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:05.776194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-52f90da1-a215-4723-b235-4a011313a605 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for project eb9e230019f042dbbc680fc3b1340d41. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:11:05.780866 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-52f90da1-a215-4723-b235-4a011313a605 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for user 35c7c83855084c188ab8a6dacb57a24b and project eb9e230019f042dbbc680fc3b1340d41. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:11:05.858946 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-52f90da1-a215-4723-b235-4a011313a605 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.101104 Jul 13 09:11:05.860379 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 307/589] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:11:05 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:07.042843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:07.042843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:07.049478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:07.049927 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:07.050725 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:07.051161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:07.143143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'services' on Instance uuid 4c84256c-3f8c-43e1-9c7d-2a433978a7bd {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:11:07.370746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-20738de2-71c4-4000-adca-24ab6f336627 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments/baa237fb-79ad-4d12-88fb-518741d25ade" status: 202 len: 0 microversion: 2.1 time: 0.333542 Jul 13 09:11:07.372668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 283/590] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:11:07 2022] DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments/baa237fb-79ad-4d12-88fb-518741d25ade => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:11:07.387535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:07.388970 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:07.408511 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:07.408963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:07.409759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:07.410227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:07.456166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-634ca20c-6827-4ede-b3d1-daff14dfa1b6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078571 Jul 13 09:11:07.457298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 308/591] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:11:07 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:08.287815 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-591936152", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "862d32ef-d286-4010-a420-61dff25da7b3"}], "security_groups": [{"name": "tempest-securitygroup--1312480902"}], "key_name": "tempest-keypair-2003080", "user_data": "}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:08.417311 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] validate_networks() for [('862d32ef-d286-4010-a420-61dff25da7b3', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:11:08.476977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:08.478067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:08.484331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.484773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.485550 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.485978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.518601 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-efc691bd-8154-47ff-a0cf-518bba887936 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045531 Jul 13 09:11:08.519454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 309/592] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:11:08 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 09:11:08.597105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:08.597710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:08.603781 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.604232 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.605005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.605444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.631275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:11:08.809673 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:11:08.810129 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:11:08.810611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:11:08.811052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:11:08.811468 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:11:08.820621 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.821081 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.821880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.822359 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.844334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for project eb9e230019f042dbbc680fc3b1340d41. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:11:08.848587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Getting quotas for user 35c7c83855084c188ab8a6dacb57a24b and project eb9e230019f042dbbc680fc3b1340d41. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:11:08.860389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:11:08.862946 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:11:08.928861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-74ce69af-6504-4e72-bf2b-99d113f5347c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 204 len: 0 microversion: 2.1 time: 0.331720 Jul 13 09:11:08.928861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 310/593] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:11:08 2022] DELETE /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 09:11:08.934424 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:08.935321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:08.941092 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.941541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.942342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:08.942778 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:08.992385 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9a267b93-b6c5-4d3f-8a7d-bc72047ce838 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709535 Jul 13 09:11:08.993036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 284/594] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:11:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:11:09.004595 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b4685590-c161-44f6-9503-c2f449ed40aa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:09.005421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b4685590-c161-44f6-9503-c2f449ed40aa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:09.067143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b4685590-c161-44f6-9503-c2f449ed40aa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:09.075170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b4685590-c161-44f6-9503-c2f449ed40aa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1234 microversion: 2.1 time: 0.075036 Jul 13 09:11:09.075763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 285/595] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:08 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1234 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:09.284592 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:09.292030 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3f1b6c23-614e-4da7-a409-7f7613ab982c tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1690 microversion: 2.1 time: 0.362422 Jul 13 09:11:09.292593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 311/596] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:08 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1690 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:10.092655 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:10.093259 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:10.102864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:10.102864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:10.102864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:10.102864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:10.164121 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:10.171861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-12f2c648-3696-4f33-bbe6-1ae419b81cd6 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1238 microversion: 2.1 time: 0.083641 Jul 13 09:11:10.172431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 286/597] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:10 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:10.309847 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:10.310412 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:10.316541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:10.316989 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:10.317739 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:10.318205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:10.452190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:10.459759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-56a8f322-3104-4976-a1ec-ef8b3aa7d148 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1690 microversion: 2.1 time: 0.154356 Jul 13 09:11:10.460325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 312/598] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:10 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:11.188584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:11.189236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:11.195944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:11.196389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:11.197148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:11.197579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:11.282949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:11.290235 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cdbb6062-942d-45c5-b837-daa097042de9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1238 microversion: 2.1 time: 0.105434 Jul 13 09:11:11.290809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 287/599] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:11 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:11.477256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:11.478506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:11.485304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:11.486213 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:11.487852 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:11.488296 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:11.898930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:11.907154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5fd30fe0-d5ab-4996-923b-bb67b869c031 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1690 microversion: 2.1 time: 0.434201 Jul 13 09:11:11.907803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 313/600] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:11 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1690 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:12.307134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:12.307886 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:12.315507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:12.316107 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:12.316992 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:12.317548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:12.384708 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:12.393104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f6798324-aedc-4767-b369-7598a1d5af05 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1238 microversion: 2.1 time: 0.090209 Jul 13 09:11:12.403265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 288/601] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:12 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:12.924606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:12.925475 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:12.927620 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:12.939221 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:12.939735 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:12.940711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:12.941152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:13.174107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:13.183551 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e4e43df4-140e-4bf0-a3ca-c3899c5fd2a5 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1690 microversion: 2.1 time: 0.262653 Jul 13 09:11:13.184219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 314/602] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:12 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:13.412051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:13.412051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:13.417671 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:13.418958 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:13.419925 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:13.420521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:13.550822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:13.559236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-922993d8-4eb2-4f0e-ac59-c2f7b4803443 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1286 microversion: 2.1 time: 0.152535 Jul 13 09:11:13.569665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 289/603] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:13 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:13.720138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-d38a37c9-c400-4a82-b2a5-a93863a5a64d req-ad9c2c37-5fd1-4674-b637-8d6dd91c8820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84256c-3f8c-43e1-9c7d-2a433978a7bd", "name": "network-vif-deleted", "tag": "5e405f48-99d1-4184-bb1c-d187e2f9e912"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:13.740060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-d38a37c9-c400-4a82-b2a5-a93863a5a64d req-ad9c2c37-5fd1-4674-b637-8d6dd91c8820 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:13.740758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-d38a37c9-c400-4a82-b2a5-a93863a5a64d req-ad9c2c37-5fd1-4674-b637-8d6dd91c8820 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:13.765618 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-d38a37c9-c400-4a82-b2a5-a93863a5a64d req-ad9c2c37-5fd1-4674-b637-8d6dd91c8820 service nova] Creating event network-vif-deleted:5e405f48-99d1-4184-bb1c-d187e2f9e912 for instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd on hv-cinder-84962 Jul 13 09:11:13.771444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-d38a37c9-c400-4a82-b2a5-a93863a5a64d req-ad9c2c37-5fd1-4674-b637-8d6dd91c8820 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055998 Jul 13 09:11:13.772813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 315/604] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:14.201471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:14.202117 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:14.216641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:14.217097 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:14.218069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:14.218682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:14.313220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:14.313668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:14.314147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'fault' on Instance uuid 4c84256c-3f8c-43e1-9c7d-2a433978a7bd {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:11:14.523150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:14.538975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cc4ffc0c-fd71-4f0d-a8b5-b492e53dfecd tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 200 len: 1335 microversion: 2.1 time: 0.341947 Jul 13 09:11:14.540005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 290/605] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:14 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 1335 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:14.578537 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:14.579357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:14.591871 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:14.592330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:14.593119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:14.593565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:14.704408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:14.719019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e034b13d-945e-476c-8183-0db7e8e3642f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1292 microversion: 2.1 time: 0.144197 Jul 13 09:11:14.721796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 316/606] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:14 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1292 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:15.563169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:15.564624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4c84256c-3f8c-43e1-9c7d-2a433978a7bd] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:15.572433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:15.573300 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:15.575123 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:15.575896 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:15.591424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] HTTP exception thrown: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd could not be found. Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Request method failure captured: Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd HTTP/1.1 Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosJU0xdskOdcTptAE5bhES6v1ZUimaLvfQtrokc0q7dinMkfp__MPqxaPVSdCgw_F6U_orIDcszlTl8BAm8AtiKOkOz440nNWH1bnO3pwnp82VQ9w7CQLOR_PrGKqaVO0YkEnsPBshTjyu3jwLh2JygaCXrK4J-Yi1JWZz9D7TzlTI Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:11:15.593632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7afbdee349034d2182240f1f7230236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7afbdee349034d2182240f1f7230236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: d9bffb24cf26486a9a8947882b52ec98 Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd could not be found. Jul 13 09:11:15.595237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '4c84256c-3f8c-43e1-9c7d-2a433978a7bd'} Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd could not be found. Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:11:15.596347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd could not be found. Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd could not be found. Jul 13 09:11:15.597711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:11:15.598971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Returning 404 to user: Instance 4c84256c-3f8c-43e1-9c7d-2a433978a7bd could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:11:15.599602 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7d176cfd-b39e-4dc5-a78b-32f6e44fb220 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd" status: 404 len: 111 microversion: 2.1 time: 0.041542 Jul 13 09:11:15.600591 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 291/607] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:15 2022] GET /compute/v2.1/servers/4c84256c-3f8c-43e1-9c7d-2a433978a7bd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:11:15.609320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e9d9d5f3-097a-4d9c-8c63-e8ebfa937b92 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '.version_select at 0x7fad2199fdc0>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:15.670414 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e9d9d5f3-097a-4d9c-8c63-e8ebfa937b92 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437501013" status: 202 len: 0 microversion: 2.1 time: 0.065182 Jul 13 09:11:15.672026 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 317/608] 10.222.0.40 () {58 vars in 1220 bytes} [Wed Jul 13 09:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437501013 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:11:15.738100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:15.738717 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:15.748553 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:15.749609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:15.751503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:15.752294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:16.059392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:16.068226 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f5af6096-5a58-4a9d-9b5f-550a88e0ad84 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.333900 Jul 13 09:11:16.079453 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 292/609] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:15 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:16.714379 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=4 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:16.722826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-9a8cf303-bc56-4851-9aa8-9bceba445716 req-0a62d4d8-541b-426b-ab9d-24681f3608e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e9d0df-5024-4fa7-8570-1878f7b39d7d", "tag": "1cdc3b76-44e3-4767-b0a2-0bb751ae5964"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:16.759514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9a8cf303-bc56-4851-9aa8-9bceba445716 req-0a62d4d8-541b-426b-ab9d-24681f3608e0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:16.761335 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9a8cf303-bc56-4851-9aa8-9bceba445716 req-0a62d4d8-541b-426b-ab9d-24681f3608e0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:16.781146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-9a8cf303-bc56-4851-9aa8-9bceba445716 req-0a62d4d8-541b-426b-ab9d-24681f3608e0 service nova] Creating event network-changed:1cdc3b76-44e3-4767-b0a2-0bb751ae5964 for instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d on hv-cinder-84962 Jul 13 09:11:16.786791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-9a8cf303-bc56-4851-9aa8-9bceba445716 req-0a62d4d8-541b-426b-ab9d-24681f3608e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073994 Jul 13 09:11:16.788082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 318/610] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:17.089013 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:17.090772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:17.098529 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:17.098976 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:17.099756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:17.100190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:17.406450 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:17.417680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dd801c55-7554-466f-9fe7-00bc3fc9779c tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.334100 Jul 13 09:11:17.419954 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 293/611] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:17 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:18.240737 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:11:18.240737 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Wed Jul 13 09:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:11:18.707105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:18.707810 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:18.714358 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:18.715751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:18.716757 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:18.717440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:18.944873 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:18.954176 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-32cb5a4f-337a-4734-8a89-6df9f6fd7b38 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.522908 Jul 13 09:11:18.954797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 319/612] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:18 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:19.972036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:19.972701 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:19.977080 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:19.977933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=8 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:19.982340 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:19.982790 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:19.983559 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:19.983998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:20.093763 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:20.094904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:20.100462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:20.101141 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:20.102939 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:20.104064 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:20.138270 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:11:20.148749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:20.161505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-21915cbd-92f5-41a7-9c99-2235b5e32048 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.192511 Jul 13 09:11:20.175608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 294/613] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:19 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:20.508991 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2566064d-761d-46df-b579-37561b66ec94 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 204 len: 0 microversion: 2.1 time: 0.420028 Jul 13 09:11:20.516091 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 320/614] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:11:20 2022] DELETE /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 09:11:20.521826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:20.522704 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:20.532910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:20.534113 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:20.535083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:20.535713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:20.684150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:20.694620 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8003e381-19fd-4406-ae76-87440d46aff6 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1508 microversion: 2.1 time: 0.178368 Jul 13 09:11:20.695291 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 295/615] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:20 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:21.181396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:21.182828 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:21.190280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:21.190582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:21.191556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:21.192186 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:21.481273 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:21.491531 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e31187c0-888a-4a4e-8ab8-d7afab1040c3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.314346 Jul 13 09:11:21.492125 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 321/616] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:21 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:21.713043 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:21.713579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:21.721171 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:21.723820 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:21.724905 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:21.726142 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:21.726923 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:21.889720 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:21.897738 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-76141fb1-e92e-4cac-9e07-e062cce64f95 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1508 microversion: 2.1 time: 0.188779 Jul 13 09:11:21.898353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 296/617] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:21 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:22.510304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:22.512266 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:22.524095 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:22.524549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:22.525332 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:22.525763 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:22.720622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:22.729996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3844933a-07a9-4033-ba62-5f472ab50f70 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.225105 Jul 13 09:11:22.731452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 322/618] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:22 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:22.915269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:22.916653 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:22.924371 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:22.925159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:22.926213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:22.926909 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:23.192033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:23.195574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:23.207131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7ab4f6a7-9d55-4f09-92f2-b28fde5a4aa4 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1508 microversion: 2.1 time: 0.293507 Jul 13 09:11:23.208244 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 297/619] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:22 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:23.713901 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-06e23a4c-394e-495e-9066-24cafc9a96e3 req-33b8fe9e-8447-4c07-b91b-567a45754c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4652c89f-12a1-40ec-86aa-705cb63de65f", "name": "network-vif-deleted", "tag": "23fec340-ea0c-4bbf-a12c-354b4909fa75"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:23.728853 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-06e23a4c-394e-495e-9066-24cafc9a96e3 req-33b8fe9e-8447-4c07-b91b-567a45754c0f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:23.729664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-06e23a4c-394e-495e-9066-24cafc9a96e3 req-33b8fe9e-8447-4c07-b91b-567a45754c0f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:23.743370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-06e23a4c-394e-495e-9066-24cafc9a96e3 req-33b8fe9e-8447-4c07-b91b-567a45754c0f service nova] Creating event network-vif-deleted:23fec340-ea0c-4bbf-a12c-354b4909fa75 for instance 4652c89f-12a1-40ec-86aa-705cb63de65f on hv-cinder-84962 Jul 13 09:11:23.748548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:23.749170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:23.750826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-06e23a4c-394e-495e-9066-24cafc9a96e3 req-33b8fe9e-8447-4c07-b91b-567a45754c0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042908 Jul 13 09:11:23.753532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 323/620] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:23.764421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:23.764874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:23.765654 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:23.766115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:24.019020 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:24.028031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dd0f6e9c-82a9-44d5-8d0e-1d092458cd45 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.283342 Jul 13 09:11:24.028691 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 298/621] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:23 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:24.225146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:24.225848 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:24.250193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:24.250992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:24.251993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:24.254387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:24.264473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:24.321922 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:24.328514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:24.329216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'fault' on Instance uuid 4652c89f-12a1-40ec-86aa-705cb63de65f {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:11:24.389905 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:24.395670 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-16c4f6c4-eaab-4b65-8def-a9665c38d630 req-a517b770-c70b-4cdd-9b3a-4c824a98ea5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e9d0df-5024-4fa7-8570-1878f7b39d7d", "name": "network-vif-plugged", "status": "completed", "tag": "1cdc3b76-44e3-4767-b0a2-0bb751ae5964"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:24.410455 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-16c4f6c4-eaab-4b65-8def-a9665c38d630 req-a517b770-c70b-4cdd-9b3a-4c824a98ea5f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:24.410694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4cf2b206-eeae-49ef-a45e-9a3ad0260e59 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 200 len: 1312 microversion: 2.1 time: 0.189671 Jul 13 09:11:24.411377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-16c4f6c4-eaab-4b65-8def-a9665c38d630 req-a517b770-c70b-4cdd-9b3a-4c824a98ea5f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:24.421041 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 324/622] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:24 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:24.434698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-16c4f6c4-eaab-4b65-8def-a9665c38d630 req-a517b770-c70b-4cdd-9b3a-4c824a98ea5f service nova] Creating event network-vif-plugged:1cdc3b76-44e3-4767-b0a2-0bb751ae5964 for instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d on hv-cinder-84962 Jul 13 09:11:24.442418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-16c4f6c4-eaab-4b65-8def-a9665c38d630 req-a517b770-c70b-4cdd-9b3a-4c824a98ea5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049160 Jul 13 09:11:24.443367 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 299/623] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:11:25.046514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:25.050204 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:25.055575 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.056175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.057084 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.057658 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.202073 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:25.209457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d7adaf69-25a2-4a78-8912-2a06c117d659 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.168315 Jul 13 09:11:25.210065 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 325/624] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:25 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:25.429221 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:25.429903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 4652c89f-12a1-40ec-86aa-705cb63de65f] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:25.436451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.437706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.437706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.438053 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.452224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] HTTP exception thrown: Instance 4652c89f-12a1-40ec-86aa-705cb63de65f could not be found. Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Request method failure captured: Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f HTTP/1.1 Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosJU0xdskOdcTptAE5bhES6v1ZUimaLvfQtrokc0q7dinMkfp__MPqxaPVSdCgw_F6U_orIDcszlTl8BAm8AtiKOkOz440nNWH1bnO3pwnp82VQ9w7CQLOR_PrGKqaVO0YkEnsPBshTjyu3jwLh2JygaCXrK4J-Yi1JWZz9D7TzlTI Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:11:25.453860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7afbdee349034d2182240f1f7230236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7afbdee349034d2182240f1f7230236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: d9bffb24cf26486a9a8947882b52ec98 Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 4652c89f-12a1-40ec-86aa-705cb63de65f could not be found. Jul 13 09:11:25.455303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '4652c89f-12a1-40ec-86aa-705cb63de65f'} Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4652c89f-12a1-40ec-86aa-705cb63de65f could not be found. Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:11:25.456051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4652c89f-12a1-40ec-86aa-705cb63de65f could not be found. Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4652c89f-12a1-40ec-86aa-705cb63de65f could not be found. Jul 13 09:11:25.457310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:25.458477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Returning 404 to user: Instance 4652c89f-12a1-40ec-86aa-705cb63de65f could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:11:25.458477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ba921a06-29a4-4395-bfbc-cdb46df32e49 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f" status: 404 len: 111 microversion: 2.1 time: 0.030365 Jul 13 09:11:25.458477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 326/625] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:25 2022] GET /compute/v2.1/servers/4652c89f-12a1-40ec-86aa-705cb63de65f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:11:25.463740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:25.464224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:25.471247 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.472048 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.472712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.472990 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.484065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-033a7931-762a-4f5e-ba73-8519341e282c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Action: 'create', calling method: .version_select at 0x7fad217170d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1052307799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcoM+Oq7zaTHLS+mg2fZvgpbVKQgR/oJtyI+lxwBYAitwpn9Fo+QvkTXCu8iWihf6Zo5HoMhLaRixTu/MC5KISz6EoTGIDhFHuYrQm+1MdamdR51J3dcOmBH7N6uNEAvw=="}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:25.499418 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:11:25.506573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-033a7931-762a-4f5e-ba73-8519341e282c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Getting quotas for project 6b5574138d6341268eae22b78af64765. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:11:25.506573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-033a7931-762a-4f5e-ba73-8519341e282c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Getting quotas for user 0a9a75227440420fb3eab1685598f2dc and project 6b5574138d6341268eae22b78af64765. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:11:25.587642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-033a7931-762a-4f5e-ba73-8519341e282c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.226987 Jul 13 09:11:25.588249 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 300/626] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:11:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:25.855044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-22f41e43-57b0-4540-a059-33fa74892ac0 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 204 len: 0 microversion: 2.1 time: 0.394776 Jul 13 09:11:25.855843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 327/627] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:11:25 2022] DELETE /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 09:11:25.864561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:25.865294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:25.872365 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.873091 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:25.874074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:25.874680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:26.023662 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:26.031652 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b486cc00-8ede-41e8-b174-08b628c2fddf tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.170887 Jul 13 09:11:26.032243 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 301/628] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:25 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:26.228119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:26.229506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:26.237068 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:26.237706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:26.238559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:26.238996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:26.385020 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:26.393740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3b256422-d30e-437d-a77b-e999ba8c677d tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.170229 Jul 13 09:11:26.404603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 328/629] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:26 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:27.050444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:27.053151 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:27.057599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:27.058211 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:27.059029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:27.059458 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:27.194209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:27.203161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b55d1ccb-a136-4acf-9c6c-9635d09d9d5d tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.157770 Jul 13 09:11:27.203790 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 302/630] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:27 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:27.412212 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:27.413002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:27.419703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:27.420351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:27.421202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:27.421645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:27.581861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:27.590628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ca30de2c-d618-4e77-b82d-953985b9db7b tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.181845 Jul 13 09:11:27.591290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 329/631] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:27 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:28.221423 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:28.222072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:28.228981 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:28.229464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:28.230947 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:28.232404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:28.387970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:28.396094 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-47dc1daf-4417-411e-99e6-61f15750cb8f tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.178789 Jul 13 09:11:28.396565 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 303/632] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:28 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:28.607761 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:28.608470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:28.615245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:28.615699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:28.617718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:28.628395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:28.769469 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:28.777790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4a40907c-831b-43d7-8422-c7aa0ff38329 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1360 microversion: 2.1 time: 0.174803 Jul 13 09:11:28.778637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 330/633] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:28 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:29.413981 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:29.414613 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:29.422268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:29.422727 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:29.423496 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:29.423953 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:29.659241 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:29.667001 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bcd41eb5-7e5e-4fd6-9514-c83dae5fc64a tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1521 microversion: 2.1 time: 0.258022 Jul 13 09:11:29.667582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 304/634] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:29 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:29.795075 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:29.796346 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:29.803353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:29.803799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:29.804558 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:29.805019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:29.956624 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:29.964194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f2ed25e2-412a-46ad-a430-ee1fa00f71c8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1546 microversion: 2.1 time: 0.173243 Jul 13 09:11:29.965391 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 331/635] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:29 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:29.987279 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:29.988082 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:29.994363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:29.997727 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:29.997727 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:29.997727 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.073471 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-58dced61-daf2-4e77-8855-b9d55f1972d8 req-0c5c879c-0a9f-4e15-ae7a-9b77562c2293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8315445c-678d-4c5c-8ecf-937e48a120a4", "name": "network-vif-deleted", "tag": "d61129b0-9f79-4508-a968-7e3a740a1f1c"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:30.082631 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-58dced61-daf2-4e77-8855-b9d55f1972d8 req-0c5c879c-0a9f-4e15-ae7a-9b77562c2293 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:30.092820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-58dced61-daf2-4e77-8855-b9d55f1972d8 req-0c5c879c-0a9f-4e15-ae7a-9b77562c2293 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.096625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-58dced61-daf2-4e77-8855-b9d55f1972d8 req-0c5c879c-0a9f-4e15-ae7a-9b77562c2293 service nova] Creating event network-vif-deleted:d61129b0-9f79-4508-a968-7e3a740a1f1c for instance 8315445c-678d-4c5c-8ecf-937e48a120a4 on hv-cinder-84962 Jul 13 09:11:30.102795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-58dced61-daf2-4e77-8855-b9d55f1972d8 req-0c5c879c-0a9f-4e15-ae7a-9b77562c2293 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 Jul 13 09:11:30.104088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 332/636] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:11:30.124488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c99f9cf1-7b72-4470-a861-f6977f2f4eaa tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140978 Jul 13 09:11:30.125137 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 305/637] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:11:29 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:30.522731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:30.523573 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:30.530354 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:30.530699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.531474 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:30.531904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.555227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7a1e85ad-18b6-4222-b453-10d0207c77e4 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/ips" status: 200 len: 152 microversion: 2.20 time: 0.157889 Jul 13 09:11:30.555794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 333/638] 10.222.0.40 () {60 vars in 1288 bytes} [Wed Jul 13 09:11:30 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/ips => generated 152 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 09:11:30.687057 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:30.687636 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:30.693893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:30.694669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.695955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:30.696390 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.732227 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:30.732740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:30.733227 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lazy-loading 'fault' on Instance uuid 8315445c-678d-4c5c-8ecf-937e48a120a4 {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:11:30.780694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bffb24cf26486a9a8947882b52ec98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afbdee349034d2182240f1f7230236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:30.788069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3bfdb8e2-b584-48c0-affb-e6709e84ba6b tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 200 len: 1310 microversion: 2.1 time: 0.108194 Jul 13 09:11:30.788695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 306/639] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:30 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:31.805003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:31.805641 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] [instance: 8315445c-678d-4c5c-8ecf-937e48a120a4] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:31.811819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:31.812268 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:31.813032 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:31.813652 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:31.828754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] HTTP exception thrown: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 could not be found. Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Request method failure captured: Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 HTTP/1.1 Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosJU0xdskOdcTptAE5bhES6v1ZUimaLvfQtrokc0q7dinMkfp__MPqxaPVSdCgw_F6U_orIDcszlTl8BAm8AtiKOkOz440nNWH1bnO3pwnp82VQ9w7CQLOR_PrGKqaVO0YkEnsPBshTjyu3jwLh2JygaCXrK4J-Yi1JWZz9D7TzlTI Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:11:31.830500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7afbdee349034d2182240f1f7230236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7afbdee349034d2182240f1f7230236f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7afbdee349034d2182240f1f7230236f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 7afbdee349034d2182240f1f7230236f Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1072371521 Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: d9bffb24cf26486a9a8947882b52ec98 Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1072371521-project Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 could not be found. Jul 13 09:11:31.832226 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '8315445c-678d-4c5c-8ecf-937e48a120a4'} Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 could not be found. Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:11:31.833216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 could not be found. Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 could not be found. Jul 13 09:11:31.834595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:11:31.835826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] Returning 404 to user: Instance 8315445c-678d-4c5c-8ecf-937e48a120a4 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:11:31.835826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-03bf9862-faa8-4356-ad03-076b493434d7 tempest-ServerRescueNegativeTestJSON-1072371521 tempest-ServerRescueNegativeTestJSON-1072371521-project] 10.222.0.40 "GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4" status: 404 len: 111 microversion: 2.1 time: 0.030957 Jul 13 09:11:31.835826 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 334/640] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:31 2022] GET /compute/v2.1/servers/8315445c-678d-4c5c-8ecf-937e48a120a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:11:32.128178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-c22c5631-5d5e-47da-8f71-88717b11d063 req-7de59e61-364e-4629-a540-5081a57993ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e9d0df-5024-4fa7-8570-1878f7b39d7d", "tag": "1cdc3b76-44e3-4767-b0a2-0bb751ae5964"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:32.142443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-c22c5631-5d5e-47da-8f71-88717b11d063 req-7de59e61-364e-4629-a540-5081a57993ca service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:32.143106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-c22c5631-5d5e-47da-8f71-88717b11d063 req-7de59e61-364e-4629-a540-5081a57993ca service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:32.161908 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-c22c5631-5d5e-47da-8f71-88717b11d063 req-7de59e61-364e-4629-a540-5081a57993ca service nova] Creating event network-changed:1cdc3b76-44e3-4767-b0a2-0bb751ae5964 for instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d on hv-cinder-84962 Jul 13 09:11:32.170019 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-c22c5631-5d5e-47da-8f71-88717b11d063 req-7de59e61-364e-4629-a540-5081a57993ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045668 Jul 13 09:11:32.176804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 307/641] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:11:33.148166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:33.148741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:33.155280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:33.155919 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:33.156885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:33.157312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:33.184096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lazy-loading 'flavor' on Instance uuid fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:11:33.717463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-121017cb-e6d2-44ba-b846-7eea1a05c384 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/action" status: 202 len: 0 microversion: 2.20 time: 0.572919 Jul 13 09:11:33.722359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 335/642] 10.222.0.40 () {62 vars in 1318 bytes} [Wed Jul 13 09:11:33 2022] POST /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:11:33.734746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:33.738007 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:33.748409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:33.752065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:33.752065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:33.752065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:33.911490 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:33.920278 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:33.922149 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:33.923344 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-358beddb-c2ac-4331-8f4e-25845b4a358f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.199953 Jul 13 09:11:33.924367 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 308/643] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:33 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:34.942819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:34.943666 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:34.950680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:34.951449 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:34.952390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:34.952983 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:35.110543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:35.118974 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:35.120532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:35.121817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7a670c44-d619-492a-bca8-151e8ea13672 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.183479 Jul 13 09:11:35.122681 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 336/644] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:34 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:36.151941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:36.152750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:36.155649 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=4 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:36.160959 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:36.164563 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:36.164563 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:36.164563 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:36.353243 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:36.363545 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:36.365315 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:36.366523 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e1e64b14-29d3-4796-9a80-ff6902f36e05 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.221831 Jul 13 09:11:36.368626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 309/645] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:36 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:37.387039 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:37.387614 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:37.394104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:37.394551 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:37.395309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:37.395735 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:37.531439 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:37.539303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:37.540808 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:37.542074 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ad34cab5-bf40-428a-a850-2b1bbeaf81fc tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.159945 Jul 13 09:11:37.543139 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 337/646] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:37 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:38.561342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:38.562110 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:38.568323 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:38.568767 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:38.569522 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:38.569956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:38.715060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:38.722859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:38.724353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:38.725477 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7940753d-625d-4ec1-bb64-89496701c023 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.169021 Jul 13 09:11:38.726027 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 310/647] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:38 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:39.742822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:39.743532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:39.750519 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:39.750965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:39.751724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:39.752162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:39.898442 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:39.907375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:39.908917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:39.910083 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-67e34579-46dd-4d38-8458-ecc5f968f424 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.171129 Jul 13 09:11:39.910636 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 338/648] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:39 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:40.927880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:40.928476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:40.935064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:40.935520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:40.936252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:40.936681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:41.088728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:41.097403 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:41.098984 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:41.100130 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-95cc97f8-b987-439e-9ee5-97aa730e4100 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.176198 Jul 13 09:11:41.100697 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 311/649] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:40 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:42.120119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:42.120798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:42.128560 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:42.129009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:42.129772 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:42.130238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:42.135382 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:42.260532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:42.268963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:42.270506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:42.271650 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-353591b1-2a3f-4ce4-80ae-19bd920db757 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.156206 Jul 13 09:11:42.272206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 339/650] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:42 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:43.289500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:43.290158 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:43.297751 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:43.298650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:43.299428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:43.299872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:43.477005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:43.486214 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:43.487796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:43.488951 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2340f3d3-7053-47bf-8005-0dfc0250d9d3 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.204147 Jul 13 09:11:43.489511 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 312/651] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:43 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:44.507928 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:44.508533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:44.516725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:44.517043 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:44.517804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:44.518430 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:44.575415 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-248622631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1052307799", "security_groups": [{"name": "tempest-secgroup-smoke-897459805"}], "networks": [{"uuid": "bf682ee0-62e0-448d-97a2-9a80bdd5bf49"}], "block_device_mapping_v2": [{"uuid": "af8ed6b8-febc-4c13-aca2-75b125f47e98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:44.678060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:44.687257 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:44.689118 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:44.689964 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-57e266cc-7447-444e-a3ec-d389e0ff5f45 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.186609 Jul 13 09:11:44.690546 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 340/652] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:44 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:44.691002 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] validate_networks() for [('bf682ee0-62e0-448d-97a2-9a80bdd5bf49', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:11:45.207111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:11:45.207795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:11:45.208284 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:11:45.208747 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:11:45.209203 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:11:45.218786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:45.219233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:45.220061 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:45.220500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:45.237496 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Getting quotas for project 6b5574138d6341268eae22b78af64765. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:11:45.241431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Getting quotas for user 0a9a75227440420fb3eab1685598f2dc and project 6b5574138d6341268eae22b78af64765. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:11:45.306558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:11:45.309164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af8ed6b8-febc-4c13-aca2-75b125f47e98',volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:11:45.702738 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-34ea1424-5f80-4d80-a6c6-66b4fe6d065a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.131993 Jul 13 09:11:45.703819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 313/653] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:11:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 09:11:45.708985 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:45.709500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:45.711513 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:45.714002 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c53decea-4277-4b76-9f97-06bad100754e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:45.714731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c53decea-4277-4b76-9f97-06bad100754e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:45.716835 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:45.717291 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:45.718108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:45.718699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:45.781100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c53decea-4277-4b76-9f97-06bad100754e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:45.789049 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c53decea-4277-4b76-9f97-06bad100754e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1088 microversion: 2.1 time: 0.078896 Jul 13 09:11:45.794389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 314/654] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:45 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:45.874364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:45.882272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:45.884036 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:45.885223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5dfb2dab-0f00-4eaa-ae66-c2c5abaec9d8 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.180263 Jul 13 09:11:45.885774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 341/655] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:45 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:46.806479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:46.807119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:46.813936 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:46.814413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:46.815176 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:46.816805 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:46.875992 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:46.883454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3d4a49b7-bf13-41be-8503-0d0b85745902 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1138 microversion: 2.1 time: 0.080867 Jul 13 09:11:46.884280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 315/656] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:46 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:46.904290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:46.905160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:46.911286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:46.911875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:46.912642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:46.913083 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:47.047793 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:47.056131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:47.057645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:47.059018 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2baa5dc6-2091-485e-aeac-fb078db0002c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.159557 Jul 13 09:11:47.059583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 342/657] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:46 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:47.900222 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:47.900972 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:47.920509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:47.922447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:47.922447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:47.922447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:48.016193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:48.023656 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2841b591-79d3-464b-9e60-a3d0f3b7679a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1194 microversion: 2.1 time: 0.127453 Jul 13 09:11:48.024645 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 316/658] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:47 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:48.078445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:48.079056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:48.085604 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:48.086075 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:48.087037 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:48.087482 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:48.233345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:48.241446 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:48.242980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:48.244134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c20db461-d765-40fe-917a-f72960df2f99 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.170734 Jul 13 09:11:48.244682 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 343/659] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:48 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:49.041209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:49.041797 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:49.049089 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:49.049539 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:49.050334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:49.050774 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:49.264190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:49.264751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:49.271530 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:49.272055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:49.275255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:49.275255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:49.414203 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:49.422978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:49.424525 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:49.425853 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-43575463-ac79-491d-8ee5-bef17de21fcf tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.166636 Jul 13 09:11:49.426303 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 344/660] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:49 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:11:49.530494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:49.538488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a0a675be-62f3-4dcd-b842-d7e246ed59df tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1271 microversion: 2.1 time: 0.501051 Jul 13 09:11:49.539070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 317/661] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:49 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1271 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:50.111678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-dd240de8-3f26-4652-8fa3-07df1b80a133 req-b45fb7fe-50a5-483e-801a-31112dc4763f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:50.120096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-dd240de8-3f26-4652-8fa3-07df1b80a133 req-b45fb7fe-50a5-483e-801a-31112dc4763f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:50.122208 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-dd240de8-3f26-4652-8fa3-07df1b80a133 req-b45fb7fe-50a5-483e-801a-31112dc4763f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:50.132969 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-dd240de8-3f26-4652-8fa3-07df1b80a133 req-b45fb7fe-50a5-483e-801a-31112dc4763f service nova] Creating event network-changed:c98f0a70-76c7-4798-9dfc-6e8275493f88 for instance d44bf150-cda8-482a-a0b9-f51d8070d972 on hv-cinder-84962 Jul 13 09:11:50.139229 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-dd240de8-3f26-4652-8fa3-07df1b80a133 req-b45fb7fe-50a5-483e-801a-31112dc4763f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165972 Jul 13 09:11:50.139837 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 345/662] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:11:50.444286 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:50.445473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:50.452661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:50.453104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:50.453864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:50.454380 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:50.470821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:50.563750 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:50.564455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:50.580616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:50.581071 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:50.581846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:50.582305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:50.598921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:50.609341 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:50.610877 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:50.612030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cd050b16-50cd-45f6-9449-b32694989238 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1745 microversion: 2.20 time: 0.171761 Jul 13 09:11:50.612754 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 318/663] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:50 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:50.716290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:50.723593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b8ef663a-dc7b-4119-afa5-685f08e6bdf9 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.164382 Jul 13 09:11:50.724198 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 346/664] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:50 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:51.630244 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:51.630844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:51.637571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:51.640051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:51.640051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:51.640051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:51.742349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:51.742883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:51.750779 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:51.751221 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:51.751983 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:51.752541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:51.773175 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:51.781491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:51.783266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:51.784582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-35483241-89c8-498f-b942-13c0440a02b1 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1745 microversion: 2.20 time: 0.158195 Jul 13 09:11:51.798145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 319/665] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:51 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:51.895975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:51.903615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-516f9a4c-26aa-4660-a05d-9190301e95e4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.165810 Jul 13 09:11:51.904364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 347/666] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:51 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:52.806617 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:52.807233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:52.815241 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:52.816771 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:52.817226 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:52.818094 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:52.823847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:52.921635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:52.922321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:52.929875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:52.929875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:52.930158 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:52.930463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:52.968293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:52.976563 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:52.978160 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:52.979422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d9b1f9d3-4c7f-45b2-8e48-d0e788de15eb tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.178128 Jul 13 09:11:52.982512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 320/667] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:52 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:53.089360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:53.097477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2c85b21d-0ccd-49c6-ab59-aaf770d94960 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.180891 Jul 13 09:11:53.098310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 348/668] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:52 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:54.004665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:54.005406 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:54.018866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:54.018866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:54.018866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:54.018866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:54.117089 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:54.119456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:54.134140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:54.135556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:54.139699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:54.140152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:54.213634 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:54.236780 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:54.242428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:54.244622 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f8e4c4c9-7a2e-488d-8ab4-0e43d7802d0f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.244350 Jul 13 09:11:54.260136 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 321/669] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:53 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:54.356663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:54.366368 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-25656022-d5b0-4ecf-b6c4-2d082fa6e11c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.254511 Jul 13 09:11:54.367190 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 349/670] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:54 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:54.646425 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-1f7c56ee-f102-4d68-8fbb-07aa6a80588e req-8173559a-a227-42bf-807b-799130f2e953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "name": "network-vif-plugged", "status": "completed", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:11:54.660894 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-1f7c56ee-f102-4d68-8fbb-07aa6a80588e req-8173559a-a227-42bf-807b-799130f2e953 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:54.661638 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-1f7c56ee-f102-4d68-8fbb-07aa6a80588e req-8173559a-a227-42bf-807b-799130f2e953 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:54.675729 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-1f7c56ee-f102-4d68-8fbb-07aa6a80588e req-8173559a-a227-42bf-807b-799130f2e953 service nova] Creating event network-vif-plugged:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:11:54.683333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-1f7c56ee-f102-4d68-8fbb-07aa6a80588e req-8173559a-a227-42bf-807b-799130f2e953 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229045 Jul 13 09:11:54.684486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 322/671] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:11:55.268438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:55.268985 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:55.275289 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:55.276631 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:55.277938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:55.278608 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:55.385367 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:55.387242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:55.389914 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:55.398973 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:55.404368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:55.404368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:55.404368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:55.476386 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:55.487233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:55.491140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:55.493715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8d2e3855-1060-48cd-97a9-f04924437b66 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.229076 Jul 13 09:11:55.509182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 350/672] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:55 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:55.584434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:55.594777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d18c77f3-0091-4aa9-8f6e-3fe7395f9777 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.214629 Jul 13 09:11:55.596036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 323/673] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:55 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:56.512774 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:56.513383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:56.519496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:56.519942 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:56.520696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:56.521180 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:56.621597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:56.621597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:56.621597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=8 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:11:56.625239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:56.625880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:56.627261 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:56.627851 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:56.695553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:56.705754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:56.708601 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:56.709902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cbc6ebdd-1ee1-466b-99f7-dcba2aeb49ae tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.201310 Jul 13 09:11:56.721469 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 351/674] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:56 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:56.794895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:56.806642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e1affecb-67e3-455c-9c57-885f5280d070 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.196761 Jul 13 09:11:56.807232 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 324/675] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:56 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:57.729543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:57.731917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:57.738434 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:57.739121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:57.739888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:57.740323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:57.825975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:57.827515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:57.836843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:57.837417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:57.838616 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:57.839255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:57.987876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:58.001025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:58.003925 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:58.005285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-82da81ba-a311-4566-a7ff-a67700bccd3d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.280434 Jul 13 09:11:58.006176 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 352/676] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:57 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:11:58.035786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:58.046969 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4e2df4b8-746a-40ac-bf75-2c66cc05ff5a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.226688 Jul 13 09:11:58.047861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 325/677] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:57 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:11:59.025929 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:59.026818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:59.034527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:59.035343 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:59.036177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:59.036949 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:59.065209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:11:59.065817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:11:59.073382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:59.073828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:59.074973 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:11:59.075534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:11:59.231687 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:59.234154 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:59.240676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2fd19d9d-2b62-4921-9d91-f45b00556e8c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.179375 Jul 13 09:11:59.241650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 326/678] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:11:59 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:11:59.242300 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:59.243817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:11:59.246087 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f6bbecd9-ba37-4f21-b624-2db165f2d85e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.223614 Jul 13 09:11:59.246645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 353/679] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:11:59 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:00.260028 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:00.261308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:00.267066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:00.267695 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:00.269515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:00.270394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:00.271472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:00.272166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:00.278532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:00.278987 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:00.280787 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:00.281225 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:00.440301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:00.459702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-efd5307c-f076-4dad-8419-260396324f1c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.205109 Jul 13 09:12:00.462071 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 327/680] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:00 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:00.509827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:00.519398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:00.521264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:00.522944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7a85a34f-484c-4709-9a85-8c4f7b2d3a64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.262883 Jul 13 09:12:00.538345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 354/681] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:00 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:00.538818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-d24600b5-31e8-40a0-88a7-2c56a7f4cd5f req-2d1c2aa4-bbea-4a35-acfe-f36588bb7551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "name": "network-vif-plugged", "status": "completed", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:00.550826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d24600b5-31e8-40a0-88a7-2c56a7f4cd5f req-2d1c2aa4-bbea-4a35-acfe-f36588bb7551 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:00.552313 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d24600b5-31e8-40a0-88a7-2c56a7f4cd5f req-2d1c2aa4-bbea-4a35-acfe-f36588bb7551 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:00.568497 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-d24600b5-31e8-40a0-88a7-2c56a7f4cd5f req-2d1c2aa4-bbea-4a35-acfe-f36588bb7551 service nova] Creating event network-vif-plugged:c98f0a70-76c7-4798-9dfc-6e8275493f88 for instance d44bf150-cda8-482a-a0b9-f51d8070d972 on hv-cinder-84962 Jul 13 09:12:00.574868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-d24600b5-31e8-40a0-88a7-2c56a7f4cd5f req-2d1c2aa4-bbea-4a35-acfe-f36588bb7551 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045480 Jul 13 09:12:00.575715 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 328/682] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:12:00.659149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-286434372", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "networks": [{"uuid": "8a64382d-2c78-430f-8ebf-0370d8f9f1b4"}]}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:00.743970 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] validate_networks() for [('8a64382d-2c78-430f-8ebf-0370d8f9f1b4', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:12:01.242366 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:12:01.242907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:12:01.243160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:12:01.243601 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:12:01.244115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:12:01.255186 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:01.256467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:01.257420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:01.257898 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:01.280327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Getting quotas for project 2362e98f5387452893f972175548189a. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:12:01.285457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Getting quotas for user 8ff085ab5e6d4d278b72b7b8c528c8d4 and project 2362e98f5387452893f972175548189a. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:12:01.298168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:12:01.300463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:12:01.429162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-03428cd9-565c-4641-8e2b-29a3c88da778 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773856 Jul 13 09:12:01.429979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 355/683] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:12:01.441346 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f1ce7692-1349-4345-9559-35a2b534ed40 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:01.442431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f1ce7692-1349-4345-9559-35a2b534ed40 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:01.476743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:01.477287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:01.496951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:01.497736 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:01.499556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:01.500135 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:01.506503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f1ce7692-1349-4345-9559-35a2b534ed40 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:01.515178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f1ce7692-1349-4345-9559-35a2b534ed40 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1218 microversion: 2.1 time: 0.078916 Jul 13 09:12:01.515968 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 329/684] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:01 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:01.548733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:01.548733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:01.570458 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:01.571000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:01.571953 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:01.572535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:01.672614 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:01.681734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-efa7428f-7005-40f1-9f95-7dd1af92ae1b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.208852 Jul 13 09:12:01.683216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 356/685] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:01 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:01.746185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:01.759770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:01.761296 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:01.762498 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-efc51671-fb66-43fd-a1c8-935086ff8a4a tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.224908 Jul 13 09:12:01.763042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 330/686] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:01 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:02.539106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:02.540490 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:02.548237 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:02.548929 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:02.549862 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:02.550496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:02.553544 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:02.622399 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:02.631005 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6f1081e1-5b3f-471c-9464-b910334f908d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1222 microversion: 2.1 time: 0.101759 Jul 13 09:12:02.641104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 357/687] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:02 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:02.700241 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:02.700855 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:02.708660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:02.715975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:02.715975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:02.715975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:02.782845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:02.783481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:02.789967 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:02.790439 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:02.798080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:02.798080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:02.912356 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:02.926177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-28ab6636-26c6-4813-89a5-ad171f204bc8 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1259 microversion: 2.1 time: 0.227604 Jul 13 09:12:02.926177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 331/688] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:02 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:02.985044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:02.993068 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:02.994614 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:02.995765 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a0a5eda3-d317-4d75-afe1-762a6bca2e86 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.217751 Jul 13 09:12:02.996326 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 358/689] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:02 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:03.649275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:03.649949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:03.657099 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:03.657860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:03.658739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:03.659240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:03.726066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:03.734580 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-303e2813-70ae-450d-a9b3-339c9186778b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1270 microversion: 2.1 time: 0.089477 Jul 13 09:12:03.735390 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 332/690] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:03 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:03.941808 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:03.942578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:03.949340 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:03.957724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:03.957724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:03.957724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.015697 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:04.016423 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:04.023676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:04.024245 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.025120 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:04.025596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.097261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:04.104748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2c18fdae-d1ef-4b44-bb68-92b332165405 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1442 microversion: 2.1 time: 0.167354 Jul 13 09:12:04.105319 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 359/691] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:03 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1442 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:04.123347 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:04.128961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:04.130652 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:04.131088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.131842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:04.132327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.243542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:04.254984 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:04.257007 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:04.259719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f40d26a4-9b94-45ca-9ae6-54077d6dc65c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1740 microversion: 2.20 time: 0.248830 Jul 13 09:12:04.262135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 333/692] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:04 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:04.286863 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:04.295370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b43b1abf-c349-42c7-9403-91eaa1bbd846 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1442 microversion: 2.1 time: 0.175785 Jul 13 09:12:04.295929 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 360/693] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:04 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1442 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:04.754262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:04.755674 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:04.763072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:04.763597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.764599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:04.765092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:04.850299 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:04.858495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ffd759b0-c8f4-4688-98de-80a0c332afb7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1276 microversion: 2.1 time: 0.109824 Jul 13 09:12:04.859125 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 334/694] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:04 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:05.280527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:05.281193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:05.287463 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:05.288008 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:05.288844 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:05.289478 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:05.506654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:05.517275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:05.518992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:05.520769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-935dde65-ba6b-4317-91f4-839d96efe8f2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1722 microversion: 2.20 time: 0.244613 Jul 13 09:12:05.532383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 361/695] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:05 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:05.877845 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:05.882970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:05.886069 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:05.886574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:05.887343 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:05.887786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.102116 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:06.111763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cec3a00a-43a1-4bd3-ab6b-d47f0e401bbe tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.238723 Jul 13 09:12:06.112504 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 335/696] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:05 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:06.177711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:06.178448 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:06.184512 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.185017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.186493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.190484 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.220095 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:12:06.271452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-cea8e9bd-6592-4c20-8292-0876b5355eb3 req-0e7dd215-aef3-4603-aab2-153fce06915c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14ba4bd-c1b6-4d36-9afb-402a857f32fb", "tag": "fc7c7334-df17-4f9d-8b8d-0c8311d44d09"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:06.290574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-cea8e9bd-6592-4c20-8292-0876b5355eb3 req-0e7dd215-aef3-4603-aab2-153fce06915c service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.291116 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-cea8e9bd-6592-4c20-8292-0876b5355eb3 req-0e7dd215-aef3-4603-aab2-153fce06915c service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.308026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-cea8e9bd-6592-4c20-8292-0876b5355eb3 req-0e7dd215-aef3-4603-aab2-153fce06915c service nova] Creating event network-changed:fc7c7334-df17-4f9d-8b8d-0c8311d44d09 for instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb on hv-cinder-84962 Jul 13 09:12:06.313424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-cea8e9bd-6592-4c20-8292-0876b5355eb3 req-0e7dd215-aef3-4603-aab2-153fce06915c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045936 Jul 13 09:12:06.323548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 336/697] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:06.523714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ffcb8dea-30fe-4046-af3c-12c4af6cb97f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "DELETE /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 204 len: 0 microversion: 2.1 time: 0.349604 Jul 13 09:12:06.524308 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 362/698] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:12:06 2022] DELETE /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:12:06.533028 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:06.533919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:06.541458 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.541863 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:06.542059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.542675 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.543135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.543567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:06.550740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.551316 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.552420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.552954 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.682838 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:06.691385 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-52316fa3-3efe-4cfc-9cf3-466497cbd8f9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1577 microversion: 2.1 time: 0.162632 Jul 13 09:12:06.691959 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 337/699] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:06 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:06.754546 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:06.763138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:06.765314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:06.766514 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6e3b40cf-6119-4abe-9f3b-51ed51589e34 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1722 microversion: 2.20 time: 0.229134 Jul 13 09:12:06.767156 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 363/700] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:06 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:06.968075 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-82955b8c-338f-4d72-9448-92fee10b8531 req-db71ac4d-5850-455c-b968-7cee2fe79f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:06.976364 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-82955b8c-338f-4d72-9448-92fee10b8531 req-db71ac4d-5850-455c-b968-7cee2fe79f73 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:06.976803 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-82955b8c-338f-4d72-9448-92fee10b8531 req-db71ac4d-5850-455c-b968-7cee2fe79f73 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:06.979450 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:06.988589 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-82955b8c-338f-4d72-9448-92fee10b8531 req-db71ac4d-5850-455c-b968-7cee2fe79f73 service nova] Creating event network-changed:c98f0a70-76c7-4798-9dfc-6e8275493f88 for instance d44bf150-cda8-482a-a0b9-f51d8070d972 on hv-cinder-84962 Jul 13 09:12:06.993494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-82955b8c-338f-4d72-9448-92fee10b8531 req-db71ac4d-5850-455c-b968-7cee2fe79f73 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153220 Jul 13 09:12:06.994086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 338/701] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:07.129207 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:07.129810 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:07.136092 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.136534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.137285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.137716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.277065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:07.277748 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:07.282579 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:07.290853 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5377be4d-13f4-4045-abcf-d747049a5b2c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.165358 Jul 13 09:12:07.291810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.292691 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.293813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.294196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 364/702] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:07 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:07.295301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.324957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a3c58950-bf9a-46b9-a34b-6f2171ba7647 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/ips" status: 200 len: 146 microversion: 2.1 time: 0.053217 Jul 13 09:12:07.325657 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 339/703] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:12:07 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:07.708809 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:07.709426 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:07.715831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.716936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.717840 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.718312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.785325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:07.785944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:07.792811 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.793469 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.794471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:07.795692 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:07.861474 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:07.877880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1cbd2a91-37c6-4e33-bd4a-794f52b342e1 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1577 microversion: 2.1 time: 0.172791 Jul 13 09:12:07.882304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 365/704] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:07 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:07.954204 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:07.962200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:07.963698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:07.964874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-59c1a2d8-4e62-4f02-8497-871c6735f540 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1722 microversion: 2.20 time: 0.183446 Jul 13 09:12:07.965422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 340/705] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:07 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:08.307940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-64717167-5a78-4d6c-b7a4-a8cfad74b2bb req-e5b4c166-3f82-43eb-9e0f-136b633a779e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "name": "network-vif-unplugged", "status": "completed", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:08.312978 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:08.313614 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:08.316887 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-64717167-5a78-4d6c-b7a4-a8cfad74b2bb req-e5b4c166-3f82-43eb-9e0f-136b633a779e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.317407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-64717167-5a78-4d6c-b7a4-a8cfad74b2bb req-e5b4c166-3f82-43eb-9e0f-136b633a779e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:08.320410 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.320883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:08.321822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.322279 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:08.330798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-64717167-5a78-4d6c-b7a4-a8cfad74b2bb req-e5b4c166-3f82-43eb-9e0f-136b633a779e service nova] Creating event network-vif-unplugged:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:12:08.335820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-64717167-5a78-4d6c-b7a4-a8cfad74b2bb req-e5b4c166-3f82-43eb-9e0f-136b633a779e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031644 Jul 13 09:12:08.336604 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 366/706] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:08.455575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:08.463081 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8b459bfa-304e-4843-90cc-8a70a941c137 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.155459 Jul 13 09:12:08.463676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 341/707] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:08 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:08.899178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:08.899870 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:08.906237 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.906672 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:08.907423 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.907885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:08.982610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:08.983752 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:08.990097 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.990799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:08.992243 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:08.992683 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:09.073308 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:09.081381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b38ac0d6-2bd4-49b2-b68d-d85372113bd6 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1577 microversion: 2.1 time: 0.186211 Jul 13 09:12:09.092080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 367/708] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:08 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:09.092080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e807383-ddd8-429b-9b0a-abf6969b822d"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:09.092080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:09.093672 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:09.094155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:09.094930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:09.095369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:09.254603 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:09.262807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:09.264463 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:09.265626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-86176c60-adff-48ae-8a22-18e97b6baa56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1725 microversion: 2.20 time: 0.287082 Jul 13 09:12:09.266217 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 342/709] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:08 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:09.283273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28d6059d-6da8-4b3d-b7ab-5c352ffe4f59"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:09.284374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:09.290517 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:09.290968 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:09.291731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:09.292166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.013441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5dfdd633-d197-46e5-b155-6b230703a416 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930130 Jul 13 09:12:10.019703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 368/710] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:12:09 2022] POST /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:10.020485 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:10.021188 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:10.032415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.032415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.032415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.032415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.210500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:10.219453 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2d78ec9a-7468-4fa7-8d49-a860ebc47f66 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.203077 Jul 13 09:12:10.220388 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 369/711] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:10 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:10.230738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:10.231350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:10.238287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.239129 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.241143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.241743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.395488 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:10.403013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cbcf22b5-f839-4fff-a77e-1b3d90ed7b47 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1577 microversion: 2.1 time: 0.181179 Jul 13 09:12:10.403582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 370/712] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:10 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:10.419950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f3f99f3c-1549-46c2-92eb-efdba7630818 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.141036 Jul 13 09:12:10.421082 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 343/713] 10.222.0.40 () {62 vars in 1363 bytes} [Wed Jul 13 09:12:09 2022] POST /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-volume_attachments => generated 188 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 09:12:10.547541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:10.548067 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:10.554711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.555150 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.555907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.556333 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.573345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:10.777962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-da0f6189-6d8c-4df5-a210-dc2d4c2e12dc req-c875091b-8481-47ac-bd89-4e0a16cc70a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028cc5e6-e410-40e7-8327-d4dbe5b6c0d3", "name": "network-vif-deleted", "tag": "41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:10.788438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-da0f6189-6d8c-4df5-a210-dc2d4c2e12dc req-c875091b-8481-47ac-bd89-4e0a16cc70a1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:10.789998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-da0f6189-6d8c-4df5-a210-dc2d4c2e12dc req-c875091b-8481-47ac-bd89-4e0a16cc70a1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:10.800566 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-da0f6189-6d8c-4df5-a210-dc2d4c2e12dc req-c875091b-8481-47ac-bd89-4e0a16cc70a1 service nova] Creating event network-vif-deleted:41c82dc1-b8a6-4a2f-9876-9f132a3a6e5d for instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 on hv-cinder-84962 Jul 13 09:12:10.805529 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-da0f6189-6d8c-4df5-a210-dc2d4c2e12dc req-c875091b-8481-47ac-bd89-4e0a16cc70a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Jul 13 09:12:10.806325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 344/714] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:12:11.179762 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-181fa430-606b-43cd-80f8-b9f8b579f325 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-volume_attachments/28d6059d-6da8-4b3d-b7ab-5c352ffe4f59" status: 202 len: 0 microversion: 2.20 time: 0.636395 Jul 13 09:12:11.180748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 371/715] 10.222.0.40 () {60 vars in 1456 bytes} [Wed Jul 13 09:12:10 2022] DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-volume_attachments/28d6059d-6da8-4b3d-b7ab-5c352ffe4f59 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:12:11.236993 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:11.237636 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:11.244086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.244551 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.245197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:11.245461 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.245805 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:11.246300 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.252511 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.253007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.253709 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.254161 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.269839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:11.293291 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:11.412975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:11.423058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-89ccd756-48c1-459a-b2dd-edfdc0fc2a5e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.181574 Jul 13 09:12:11.423696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 372/716] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:11 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:11.428196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:11.428824 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:11.435918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.437789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.438599 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.439032 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.508376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:11.511082 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:11.517135 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-215aa91d-bd2e-4747-93ab-c4f18d013662 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 200 len: 1225 microversion: 2.1 time: 0.092436 Jul 13 09:12:11.517709 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 373/717] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:11 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:11.531372 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-70523205-4a5b-4b78-8bf4-6752db2a3046 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "POST /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/action" status: 202 len: 0 microversion: 2.20 time: 0.298582 Jul 13 09:12:11.532391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 345/718] 10.222.0.40 () {62 vars in 1318 bytes} [Wed Jul 13 09:12:11 2022] POST /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:12:11.540118 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:11.540717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:11.576033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.577436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.583798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:11.583798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:11.724460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:11.735516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:11.735653 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:11.736752 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e8837290-340c-448f-bde3-29659eed3cea tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1673 microversion: 2.20 time: 0.200470 Jul 13 09:12:11.737548 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 374/719] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:11 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:12.441091 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:12.441970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:12.449112 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:12.449702 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:12.450489 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:12.450924 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:12.534596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:12.535789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:12.546260 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:12.547711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:12.549333 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:12.550505 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:12.575656 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] HTTP exception thrown: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Request method failure captured: Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 HTTP/1.1 Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoum7V30qQP4k4lIVCLvO_Gi3wU-AMNV_UoLTdCIi4ZTVS8T57FWL3ZlFf3LXdqPDEpZF3Ej7eaaUqJNYwEzazzoO_82XE9noBFRv4K1PWBQbQiQf3YnsrgmA01bXZlzCHysxN6opfra_IpHkyis3worO_RNpQ7_URWfNzXEfcW_b6k Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:12:12.577312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02051a1f629a48199bb1eb504c747294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02051a1f629a48199bb1eb504c747294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 6f101dab08684c2483f67a9357efeae8 Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:12:12.579494 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '028cc5e6-e410-40e7-8327-d4dbe5b6c0d3'} Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:12:12.588597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:12:12.589833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:12.590947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Returning 404 to user: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:12:12.590947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-51d9ca2e-803a-44a0-be64-b0510d1b1a25 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 404 len: 111 microversion: 2.1 time: 0.049923 Jul 13 09:12:12.590947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 375/720] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:12 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:12:12.592967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:12.601209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-13f529a8-334c-44fc-95c5-53bad763974c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.165699 Jul 13 09:12:12.609644 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 346/721] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:12 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:12.677377 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1986304909", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2103770607", "security_groups": [{"name": "tempest-secgroup-smoke-1950628113"}], "block_device_mapping_v2": [{"uuid": "d9e32da9-45d4-4c4f-b777-dd8c91a74f11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b440154-a6c9-4139-b7ed-df54c627be50"}]}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:12.757084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:12.757756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:12.764638 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:12.765086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:12.766681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:12.767098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:12.793093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] validate_networks() for [('3b440154-a6c9-4139-b7ed-df54c627be50', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:12:12.906465 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:12.914681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:12.916195 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:12.917331 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d2afd67f-c0fd-40c0-b62c-11c179b7d091 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1675 microversion: 2.20 time: 0.165197 Jul 13 09:12:12.924818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 347/722] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:12 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:13.180331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:12:13.180755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:12:13.181227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:12:13.181635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:12:13.182064 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:12:13.192857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:13.192961 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:13.193835 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:13.194363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:13.212148 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for project 02051a1f629a48199bb1eb504c747294. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:12:13.216011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for user 6f101dab08684c2483f67a9357efeae8 and project 02051a1f629a48199bb1eb504c747294. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:12:13.218265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:13.274150 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:12:13.276321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9e32da9-45d4-4c4f-b777-dd8c91a74f11',volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:12:13.624868 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:13.626637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:13.633292 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:13.634024 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:13.636196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:13.636196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:13.640349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-af0415ad-5655-4d93-b785-b0fb510bee8a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.966852 Jul 13 09:12:13.645944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 376/723] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:12:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:12:13.651034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1f9df8ae-8b7d-42b8-b039-b50c736ad21d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:13.651770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1f9df8ae-8b7d-42b8-b039-b50c736ad21d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:13.705265 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1f9df8ae-8b7d-42b8-b039-b50c736ad21d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:13.713443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1f9df8ae-8b7d-42b8-b039-b50c736ad21d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1095 microversion: 2.1 time: 0.066093 Jul 13 09:12:13.714229 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 377/724] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:13 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:13.851914 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:13.860163 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7d64f38d-daa9-4963-ba2c-ead4311fb681 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.238582 Jul 13 09:12:13.860956 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 348/725] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:13 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:13.942568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:13.943177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:13.949384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:13.949831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:13.950628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:13.951058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:14.093194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:14.103157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:14.104703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:14.106096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-08f2b948-5927-4923-b4ff-cdd9da7b7171 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.168068 Jul 13 09:12:14.107125 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 378/726] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:13 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:14.731316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:14.731927 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:14.746697 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:14.747765 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:14.756239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:14.757010 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:14.878275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:14.879549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:14.887031 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:14.887738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:14.903346 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:14.904392 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:15.014293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:15.024279 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b6f4621e-d220-4f20-85d5-7f3d659b3eb8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1145 microversion: 2.1 time: 0.297206 Jul 13 09:12:15.036813 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 349/727] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:14 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1145 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:15.125804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:15.126497 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:15.133186 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:15.134132 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:15.135225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:15.135826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:15.137225 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:15.149765 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a077d120-f1b4-47d7-adf3-fa3fe9f58a7a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.276272 Jul 13 09:12:15.151290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 379/728] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:14 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:15.311866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:15.321362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:15.323207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:15.324371 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5ce91c63-4ccd-4fd4-aadf-5cbed80ac337 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.203006 Jul 13 09:12:15.325400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 350/729] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:15 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:16.042829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:16.043441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:16.050510 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.051085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.051928 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.052425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.116605 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:16.124473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-badcfb86-7e0e-4b5a-aa8b-8d41a93d7943 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.085445 Jul 13 09:12:16.125170 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 380/730] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:16 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:16.168386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:16.168966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:16.176468 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.176914 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.177668 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.178119 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.332159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:16.339627 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a6966279-6e61-4943-ad62-3ced89fc7c03 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.175202 Jul 13 09:12:16.340438 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 351/731] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:16 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:16.347979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:16.347979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:16.353232 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.353687 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.354481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.354938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.524436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:16.536417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:16.538216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:16.539629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-66173b08-fead-4cd6-8e6b-0f0e6242a78d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.198820 Jul 13 09:12:16.540294 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 381/732] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:16 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:16.576662 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-18c91058-200a-46b3-b0f3-72257b7fe9dc req-34a40f54-45fd-426b-84bd-f45ecc0c75e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14ba4bd-c1b6-4d36-9afb-402a857f32fb", "name": "network-vif-plugged", "status": "completed", "tag": "fc7c7334-df17-4f9d-8b8d-0c8311d44d09"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:16.585796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-18c91058-200a-46b3-b0f3-72257b7fe9dc req-34a40f54-45fd-426b-84bd-f45ecc0c75e9 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:16.586267 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-18c91058-200a-46b3-b0f3-72257b7fe9dc req-34a40f54-45fd-426b-84bd-f45ecc0c75e9 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:16.599026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-18c91058-200a-46b3-b0f3-72257b7fe9dc req-34a40f54-45fd-426b-84bd-f45ecc0c75e9 service nova] Creating event network-vif-plugged:fc7c7334-df17-4f9d-8b8d-0c8311d44d09 for instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb on hv-cinder-84962 Jul 13 09:12:16.604074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-18c91058-200a-46b3-b0f3-72257b7fe9dc req-34a40f54-45fd-426b-84bd-f45ecc0c75e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Jul 13 09:12:16.604659 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 352/733] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:17.142538 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:17.143183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:17.149815 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:17.150370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:17.151148 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:17.151585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:17.217578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:17.226986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-737e9238-c3fe-478e-99a0-7430b4f8587f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.088503 Jul 13 09:12:17.227566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 382/734] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:17 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:17.359317 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:17.361808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:17.370629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:17.371650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:17.372766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:17.373560 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:17.395565 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:17.528320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:17.537128 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c917d970-d264-4fa6-92f2-8185311d7509 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.183341 Jul 13 09:12:17.540288 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 353/735] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:17 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:17.558229 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:17.558997 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:17.566403 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:17.567305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:17.568505 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:17.569210 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:17.708556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:17.718283 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:17.720895 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:17.722337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-897038a6-e821-4327-a266-f1490e34d0aa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.168258 Jul 13 09:12:17.722902 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 383/736] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:17 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:18.244729 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:18.245368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:18.252318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:18.252766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:18.253517 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:18.253948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:18.329131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:18.336717 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e1acf1d3-472f-4bbf-8c13-2825bb5201c9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.095815 Jul 13 09:12:18.337476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 354/737] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:18 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:18.556430 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:18.557208 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:18.563819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:18.564367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:18.565201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:18.565698 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:18.706773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:18.720836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a037577b-01fc-4358-80bd-f78632be929a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.165258 Jul 13 09:12:18.730274 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 384/738] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:18 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:18.740876 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:18.741581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:18.748206 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:18.748749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:18.749682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:18.750196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:18.886769 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:18.895729 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:18.897391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:18.898650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e52d6830-0acc-44de-a1bf-f23cede6b177 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.161906 Jul 13 09:12:18.899227 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 355/739] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:18 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:19.354204 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:19.355171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:19.361740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:19.362552 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:19.363556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:19.364231 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:19.432582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:19.441901 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0536837f-642f-407f-bd9f-50e074808337 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.091483 Jul 13 09:12:19.451821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 385/740] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:19 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:19.739465 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:19.740780 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:19.748791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:19.750258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:19.751304 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:19.751833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:19.895242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:19.903596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0c32e27e-e859-49a3-bc1f-8c5c89279c0c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.170650 Jul 13 09:12:19.904343 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 356/741] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:19 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:19.916882 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:19.918440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:19.927170 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:19.929733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:19.929733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:19.929733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:20.070976 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:20.079477 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:20.081359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:20.082213 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a042b4ba-7f8f-449f-979d-cfc2c3148baa tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.169299 Jul 13 09:12:20.083112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 386/742] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:19 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:20.459685 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:20.460285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:20.466473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:20.466918 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:20.467676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:20.468109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:20.535830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:20.543392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-825ccbe7-444b-4e34-80ec-eca93e4563e4 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.087578 Jul 13 09:12:20.549626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 357/743] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:20 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:20.920562 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:20.921174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:20.928039 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:20.928479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:20.929238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:20.929923 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:21.078486 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:21.082134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:21.086731 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4afc9bf0-cce4-4326-8e73-dd31022c4782 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.169922 Jul 13 09:12:21.087405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 387/744] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:20 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:21.101181 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:21.101818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:21.108190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:21.108703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:21.109676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:21.110220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:21.251295 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:21.259788 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:21.261312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:21.262495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-25cf0bf1-2434-48eb-ba47-2ab34f6ade64 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.165331 Jul 13 09:12:21.263347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 358/745] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:21 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:21.561499 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:21.564307 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:21.573586 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:21.574349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:21.575132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:21.575571 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:21.642543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:21.651117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8d52b140-5d9a-4437-a34b-fca52d86a0d2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.094227 Jul 13 09:12:21.651700 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 388/746] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:21 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:22.112293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:22.113737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:22.121918 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:22.122579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:22.123561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:22.124157 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:22.267309 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:22.275527 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a0aa66b3-74c6-4224-bf6e-0d658206f6cc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.173291 Jul 13 09:12:22.275527 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 359/747] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:22 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:22.280633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:22.281412 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:22.288278 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:22.294088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:22.294088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:22.294088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:22.440491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:22.449189 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:22.450766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:22.452131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3cbf9073-fce1-4374-8f86-ade9c3a52ba0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.175147 Jul 13 09:12:22.452685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 389/748] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:22 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:22.668329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:22.668942 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:22.676594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:22.677040 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:22.677825 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:22.678286 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:22.751818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:22.759909 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-14955922-f970-4282-a6f4-4edd5de3d28e tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.095354 Jul 13 09:12:22.760579 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 360/749] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:22 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:23.291224 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:23.291835 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:23.293676 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:23.299348 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:23.299823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:23.300573 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:23.301100 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:23.430133 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:23.437948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-402dc2ce-a2c4-4cd7-92a6-85449ffe90fc tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.150046 Jul 13 09:12:23.438534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 390/750] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:23 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:23.470593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:23.471202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:23.473458 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=86 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:23.478175 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:23.486741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:23.486741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:23.486741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:23.608364 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:23.616499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:23.618062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:23.619223 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-18688349-05ff-414d-86f8-44e4c22cf2ff tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.152936 Jul 13 09:12:23.619786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 361/751] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:23 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:23.776727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:23.777321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:23.779242 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=8 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:23.785282 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:23.785724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:23.786519 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:23.786992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:23.853057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:23.860600 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-18e4e2c5-74f6-483c-a746-5116ff5b75d7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1193 microversion: 2.1 time: 0.087739 Jul 13 09:12:23.861164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 391/752] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:23 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:24.455270 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:24.455882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:24.462141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:24.462593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:24.463372 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:24.463826 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:24.595434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:24.603192 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cd5fd9a5-f328-4373-9a1d-fed9746a982e tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.152515 Jul 13 09:12:24.603780 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 362/753] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:24 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:24.636792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:24.637407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:24.644261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:24.644648 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:24.645407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:24.645842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:24.775899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:24.785286 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:24.786846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:24.788007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-590be588-8e1e-4512-800d-16b452d4432f tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.155309 Jul 13 09:12:24.788566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 392/754] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:24 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:24.877823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:24.878477 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:24.884725 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:24.888828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:24.888828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:24.888828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:24.952193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:24.959792 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-937d0925-ef56-4364-ac30-2dbd91a213c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1201 microversion: 2.1 time: 0.086521 Jul 13 09:12:24.960359 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 363/755] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:24 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:25.622616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:25.623564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:25.630759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:25.634183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:25.634183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:25.634183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:25.770688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:25.778045 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e180bd26-f1ac-4ba8-95d8-d8b76cd7a0db tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.159268 Jul 13 09:12:25.778602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 393/756] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:25 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:25.806137 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:25.806793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:25.813296 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:25.813745 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:25.814542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:25.814984 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:25.976854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:25.977681 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:25.985131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:25.985775 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:25.989187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:25.989886 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.016086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:26.035435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:26.035435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:26.035435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-261f1c27-525b-4b44-b48b-5302c86bc5e2 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.230260 Jul 13 09:12:26.035804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 364/757] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:25 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:26.076327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:26.085964 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4644abbe-cc4a-4dff-814f-1467ef1f8f7c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1211 microversion: 2.1 time: 0.113076 Jul 13 09:12:26.086823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 394/758] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:25 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:26.112188 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:26.113190 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:26.119578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:26.120031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.120825 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:26.121265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.151233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-be538f26-cef4-45b7-af95-14e1b55e618a tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042965 Jul 13 09:12:26.151712 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 365/759] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:12:26 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:26.161992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:26.162587 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:26.168611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:26.169051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.169797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:26.170249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.198393 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-31d2dec1-85e8-4f85-b5ae-e937121200a1 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/9e807383-ddd8-429b-9b0a-abf6969b822d" status: 200 len: 194 microversion: 2.1 time: 0.040245 Jul 13 09:12:26.199142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 395/760] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Jul 13 09:12:26 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/9e807383-ddd8-429b-9b0a-abf6969b822d => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:26.797013 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:26.801777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:26.804121 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:26.804572 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.805350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:26.805785 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:26.944311 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:26.952407 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a59a7bf1-f816-4b13-8693-974169ba116b tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.160760 Jul 13 09:12:26.957603 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 366/761] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:26 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:27.051752 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:27.052330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:27.058840 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:27.060768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:27.060768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:27.060768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:27.107117 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:27.107967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:27.115654 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:27.116235 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:27.117204 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:27.117643 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:27.215355 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:27.225499 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:27.227081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:27.228378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-22c79ca4-9aa3-4b4f-8120-e6cd588046c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.180788 Jul 13 09:12:27.229245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 396/762] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:27 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:27.351161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:27.358700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6083b326-0b87-4b71-80dc-b5df8e98a0fd tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1279 microversion: 2.1 time: 0.255842 Jul 13 09:12:27.359859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 367/763] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:27 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:27.970647 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:27.971205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:27.978934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:27.979381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:27.980138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:27.980571 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.129384 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:28.139322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e78af43c-52e4-419f-82ab-f12f69dd3b3f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1318 microversion: 2.1 time: 0.172027 Jul 13 09:12:28.149634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 397/764] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:27 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:28.249115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:28.250447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:28.263558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.264070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.264879 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.265399 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.377310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:28.377918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:28.387036 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.387479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.388432 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.389030 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.475205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:28.487861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:28.493872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:28.493872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d25d1d73-34eb-49c6-8871-081aecefaf7b tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.245758 Jul 13 09:12:28.493872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 368/765] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:28 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:28.497766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-5ff65b8f-068a-4a57-95d3-408718fb1da7 req-4e99f6e7-fbe7-417b-9169-03fe0b6aa4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b9d222-8b85-4225-b1ff-02aaa569e511", "tag": "f0112888-5873-4829-b011-1ecd352cf3ac"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:28.515401 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-5ff65b8f-068a-4a57-95d3-408718fb1da7 req-4e99f6e7-fbe7-417b-9169-03fe0b6aa4be service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.517145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-5ff65b8f-068a-4a57-95d3-408718fb1da7 req-4e99f6e7-fbe7-417b-9169-03fe0b6aa4be service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.528552 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-5ff65b8f-068a-4a57-95d3-408718fb1da7 req-4e99f6e7-fbe7-417b-9169-03fe0b6aa4be service nova] Creating event network-changed:f0112888-5873-4829-b011-1ecd352cf3ac for instance 57b9d222-8b85-4225-b1ff-02aaa569e511 on hv-cinder-84962 Jul 13 09:12:28.535520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-5ff65b8f-068a-4a57-95d3-408718fb1da7 req-4e99f6e7-fbe7-417b-9169-03fe0b6aa4be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043042 Jul 13 09:12:28.541958 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 369/766] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:28.577759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:28.587316 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fa5eb2f4-8446-4f31-8fe5-dfa42b6a2871 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1279 microversion: 2.1 time: 0.214271 Jul 13 09:12:28.588091 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 398/767] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:28 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1279 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:28.899232 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5a6675f-bdd1-4cf4-8fc3-8b5bbac9071e"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:28.900383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:28.907083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.907518 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.908283 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:28.908718 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:28.986430 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:29.157705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:29.158359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:29.165205 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:29.165763 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:29.166593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:29.167029 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:29.299613 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:29.307064 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-07258177-cb39-41ac-b346-9ed2261512ed tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1506 microversion: 2.1 time: 0.154084 Jul 13 09:12:29.307634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 399/768] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:29 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:29.509262 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:29.509926 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:29.517164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:29.517703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:29.518390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:29.518820 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:29.590427 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1f32e733-5e2c-4078-9720-4b371aa72d86 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "POST /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695244 Jul 13 09:12:29.591199 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 370/769] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:12:28 2022] POST /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:29.616996 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:29.617689 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:29.625589 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:29.626650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:29.627621 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:29.628059 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:29.662741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:29.671300 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:29.673634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:29.674823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0f6b9cf6-da1d-4b79-b974-0b910373ed56 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.169832 Jul 13 09:12:29.677396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 400/770] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:29 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 09:12:29.796207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:29.804694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-408d15c2-6c44-4ee2-9752-56734d9df7a0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.191819 Jul 13 09:12:29.805278 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 371/771] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:29 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:30.503612 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-9d67e078-3446-48ee-9e6f-4bb295ce177f req-8db6a63d-af08-4335-854f-0e40ca02baab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "name": "network-vif-plugged", "status": "completed", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:30.512466 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9d67e078-3446-48ee-9e6f-4bb295ce177f req-8db6a63d-af08-4335-854f-0e40ca02baab service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:30.512908 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9d67e078-3446-48ee-9e6f-4bb295ce177f req-8db6a63d-af08-4335-854f-0e40ca02baab service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:30.524432 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-9d67e078-3446-48ee-9e6f-4bb295ce177f req-8db6a63d-af08-4335-854f-0e40ca02baab service nova] Creating event network-vif-plugged:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:12:30.530361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-9d67e078-3446-48ee-9e6f-4bb295ce177f req-8db6a63d-af08-4335-854f-0e40ca02baab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031023 Jul 13 09:12:30.531080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 401/772] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:12:30.696695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:30.697298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:30.704811 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:30.713499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:30.713499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:30.713499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:30.822580 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:30.823471 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:30.835654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:30.836288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:30.837174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:30.838922 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:30.848237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:30.856783 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:30.858356 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:30.860260 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d2e122cb-979d-47c8-940d-55bee0a0fa29 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.167606 Jul 13 09:12:30.860980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 372/773] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:30 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:30.992096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:31.000146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d98266dc-c09f-4358-8a65-2fd3f785bdbc tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.182020 Jul 13 09:12:31.000865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 402/774] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:30 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:31.878294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:31.878888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:31.885646 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:31.886115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:31.886873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:31.887310 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:32.017149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:32.021538 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:32.024124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:32.024564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:32.025331 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:32.025757 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:32.027481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:32.037068 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:32.038836 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:32.040012 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-34d0b051-7e5e-4906-8db6-888d72421930 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.165823 Jul 13 09:12:32.040676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 373/775] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:31 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:32.168539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:32.177191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6be4689c-8850-4267-9b72-c57da16f1de3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.164337 Jul 13 09:12:32.177778 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 403/776] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:32 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:33.061895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:33.062740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:33.069000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:33.069475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:33.070293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:33.070729 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:33.197915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:33.199490 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:33.207425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:33.207591 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:33.207883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:33.208666 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:33.209110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:33.215891 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:33.217479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:33.218765 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e70c0f37-6eee-4432-b94e-15b2c6f78d61 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1731 microversion: 2.20 time: 0.163243 Jul 13 09:12:33.219320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 374/777] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:33 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:33.345945 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:33.353725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-77ac6958-4ee9-4c45-b6cf-d749a494a743 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.161010 Jul 13 09:12:33.354333 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 404/778] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:33 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:34.237783 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:34.238448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:34.244839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:34.245282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:34.246045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:34.246483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:34.370565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:34.371175 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:34.379462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:34.379974 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:34.380758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:34.381066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:34.381388 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:34.386108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=100 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:34.389519 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:34.391080 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:34.392827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d18e5707-cadc-46c1-ba82-59821a79c01d tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1718 microversion: 2.20 time: 0.160003 Jul 13 09:12:34.393437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 375/779] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:12:34 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:12:34.516628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:34.524181 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-040ce317-aac2-4765-a5b8-935bfaa390c0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.157506 Jul 13 09:12:34.524749 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 405/780] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:34 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:35.542023 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:35.542854 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:35.549734 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:35.550271 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:35.551173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:35.551499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:35.684930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:35.693158 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-816416ef-21f2-41ca-90ec-21d3e930772d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.155117 Jul 13 09:12:35.693730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 376/781] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:35 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:36.709984 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:36.710615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:36.717095 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:36.720392 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:36.720392 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:36.720392 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:36.859082 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:36.867797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5d0bf31e-ad03-4227-aa24-913236a81e0f tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.161781 Jul 13 09:12:36.868368 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 406/782] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:36 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:37.119132 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:37.120460 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:37.127359 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.127820 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.128599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.129042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.160288 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d4c2cea0-6fb3-4cdd-87db-583b49338a42 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045445 Jul 13 09:12:37.160888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 377/783] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:12:37 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:37.297037 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:37.297522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:37.304060 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.304505 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.305249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.305677 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.335397 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8ebee582-bcc3-4673-93c6-5471e5751d49 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/9e807383-ddd8-429b-9b0a-abf6969b822d" status: 200 len: 194 microversion: 2.1 time: 0.042212 Jul 13 09:12:37.336145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 407/784] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Jul 13 09:12:37 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/9e807383-ddd8-429b-9b0a-abf6969b822d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:37.348173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:37.348746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:37.355038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.355480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.356239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.356669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.438803 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lazy-loading 'services' on Instance uuid b0e9d0df-5024-4fa7-8570-1878f7b39d7d {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:12:37.636940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8ad40651-eb1a-46dc-9eab-ac2ebacdaa57 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/9e807383-ddd8-429b-9b0a-abf6969b822d" status: 202 len: 0 microversion: 2.1 time: 0.293812 Jul 13 09:12:37.637541 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 378/785] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:12:37 2022] DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/9e807383-ddd8-429b-9b0a-abf6969b822d => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:12:37.885048 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:37.885686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:37.892130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.892668 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:37.893455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:37.893907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:38.025934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:38.034476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-593cddd0-386b-4eef-8ebf-9dd46f1a8a6d tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.153558 Jul 13 09:12:38.035041 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 408/786] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:37 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:39.053256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:39.053967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:39.061285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:39.061807 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:39.069213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:39.069213 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:39.209041 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:39.216676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3ce351d2-5f2e-4f0d-82a5-4d6185173638 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.169180 Jul 13 09:12:39.217333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 379/787] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:39 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:39.803899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:39.804462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:39.810701 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:39.811143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:39.812045 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:39.812732 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:39.842629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b81d6242-89ce-4c50-8eb5-604721a891a8 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/e5a6675f-bdd1-4cf4-8fc3-8b5bbac9071e" status: 200 len: 194 microversion: 2.1 time: 0.042716 Jul 13 09:12:39.843210 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 409/788] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Jul 13 09:12:39 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/e5a6675f-bdd1-4cf4-8fc3-8b5bbac9071e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:39.853566 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:39.854087 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:39.860592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:39.861863 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:39.862671 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:39.863116 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:39.943451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lazy-loading 'services' on Instance uuid b0e9d0df-5024-4fa7-8570-1878f7b39d7d {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:12:40.174979 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5ec16321-0e6e-495d-9b47-b8e76e5af9dc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/e5a6675f-bdd1-4cf4-8fc3-8b5bbac9071e" status: 202 len: 0 microversion: 2.1 time: 0.324210 Jul 13 09:12:40.175570 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 380/789] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:12:39 2022] DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments/e5a6675f-bdd1-4cf4-8fc3-8b5bbac9071e => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:12:40.233083 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:40.233689 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:40.239982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:40.240461 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:40.241208 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:40.241636 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:40.390607 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:40.398621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-696a2884-f2a5-4c9a-ac6f-2e2539a9a508 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.169347 Jul 13 09:12:40.399351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 410/790] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:40 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:40.632994 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-d3cbf5ed-6e3d-4b7c-ab9c-abfef0912821 req-7c6a3cb3-0fe0-434d-8c5e-dfa0ea37ee27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b9d222-8b85-4225-b1ff-02aaa569e511", "name": "network-vif-plugged", "status": "completed", "tag": "f0112888-5873-4829-b011-1ecd352cf3ac"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:40.641351 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d3cbf5ed-6e3d-4b7c-ab9c-abfef0912821 req-7c6a3cb3-0fe0-434d-8c5e-dfa0ea37ee27 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:40.641789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-d3cbf5ed-6e3d-4b7c-ab9c-abfef0912821 req-7c6a3cb3-0fe0-434d-8c5e-dfa0ea37ee27 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:40.809338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-d3cbf5ed-6e3d-4b7c-ab9c-abfef0912821 req-7c6a3cb3-0fe0-434d-8c5e-dfa0ea37ee27 service nova] Creating event network-vif-plugged:f0112888-5873-4829-b011-1ecd352cf3ac for instance 57b9d222-8b85-4225-b1ff-02aaa569e511 on hv-cinder-84962 Jul 13 09:12:40.814975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-d3cbf5ed-6e3d-4b7c-ab9c-abfef0912821 req-7c6a3cb3-0fe0-434d-8c5e-dfa0ea37ee27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185375 Jul 13 09:12:40.815978 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 381/791] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:41.415421 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:41.416026 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:41.422562 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:41.422949 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:41.423705 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:41.424137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:41.564593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:41.572191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ddb23051-af57-43de-b0d8-f03598948949 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.160572 Jul 13 09:12:41.572758 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 411/792] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:41 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:42.386788 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:42.387818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:42.394849 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.395297 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.396052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.396484 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.424185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cc7757fb-2134-43f5-b9ac-8efa80332784 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042300 Jul 13 09:12:42.425557 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 382/793] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:12:42 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:12:42.545132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:42.546116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:42.553317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.553766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.554585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.555018 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.584645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-86e9dd26-f012-4f08-9169-e86e4f138f93 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043535 Jul 13 09:12:42.585202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 412/794] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:12:42 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:12:42.588520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:42.589205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:42.595286 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.595737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.596512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.596963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.645945 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:42.646716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:42.652972 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.653502 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.654363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.654799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.680821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:12:42.733168 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:42.741888 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-738005e8-057b-4d4b-af0e-92bc4c276b50 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1267 microversion: 2.1 time: 0.157197 Jul 13 09:12:42.742478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 383/795] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:42 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:12:42.917167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-61198ba1-d75f-41a8-94ae-6f137e3d7e5f tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 204 len: 0 microversion: 2.1 time: 0.274900 Jul 13 09:12:42.917783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 413/796] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:12:42 2022] DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 09:12:42.926577 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:42.927178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:42.933166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.933605 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:42.934385 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:42.934818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:43.067501 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:43.072074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e515b47c-ed6e-4de0-840b-36cf8bdb49d2 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1671 microversion: 2.1 time: 0.150078 Jul 13 09:12:43.072629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 384/797] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:42 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:43.758975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:43.759674 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:43.762121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:43.766898 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:43.767351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:43.768740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:43.769200 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:43.905633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:43.913401 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-cb7892d9-76a2-4881-8f2e-4b45716a01ae tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1453 microversion: 2.1 time: 0.158902 Jul 13 09:12:43.913980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 414/798] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:43 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:43.929788 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:43.930424 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:43.936832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:43.937275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:43.938021 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:43.938474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:43.953644 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:44.069746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:44.077060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3ecc468c-4b2e-467c-8a83-701da40a9553 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1453 microversion: 2.1 time: 0.151067 Jul 13 09:12:44.077610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 385/799] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:43 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:44.088502 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:44.089114 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:44.095103 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:44.095556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:44.096356 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:44.096806 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:44.224506 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:44.232108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-82e414cf-aeb9-44e2-893f-4760ad5e00f3 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1671 microversion: 2.1 time: 0.147437 Jul 13 09:12:44.232686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 415/800] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:44 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:45.249720 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:45.250482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:45.257823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:45.258554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:45.259323 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:45.259759 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:45.679841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a630545b-7997-4456-8ff6-b413fe04bc8a", "device": "/dev/sdb"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:45.681402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:45.688153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:45.688596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:45.689362 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:45.689791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:45.803335 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:45.812350 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ea48a1cc-0972-4981-b6af-315e65878bcc tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1671 microversion: 2.1 time: 0.566536 Jul 13 09:12:45.812914 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 386/801] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:45 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1671 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:46.641807 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-aeba23f2-1fd0-45c0-8537-a3c8596e1b94 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "POST /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966953 Jul 13 09:12:46.647670 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 416/802] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:12:45 2022] POST /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:12:46.737752 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-0a9ef9c2-a331-4cae-8b6d-9cffe78b1bdb req-49f6fae4-3efe-4081-b976-61b487e26477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b9d222-8b85-4225-b1ff-02aaa569e511", "tag": "f0112888-5873-4829-b011-1ecd352cf3ac"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:46.746097 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-0a9ef9c2-a331-4cae-8b6d-9cffe78b1bdb req-49f6fae4-3efe-4081-b976-61b487e26477 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:46.746512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-0a9ef9c2-a331-4cae-8b6d-9cffe78b1bdb req-49f6fae4-3efe-4081-b976-61b487e26477 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:46.759198 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-0a9ef9c2-a331-4cae-8b6d-9cffe78b1bdb req-49f6fae4-3efe-4081-b976-61b487e26477 service nova] Creating event network-changed:f0112888-5873-4829-b011-1ecd352cf3ac for instance 57b9d222-8b85-4225-b1ff-02aaa569e511 on hv-cinder-84962 Jul 13 09:12:46.764486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-0a9ef9c2-a331-4cae-8b6d-9cffe78b1bdb req-49f6fae4-3efe-4081-b976-61b487e26477 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030801 Jul 13 09:12:46.765078 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 387/803] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:46.833515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:46.835841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:46.841441 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:46.842277 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:46.843219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:46.843805 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:46.923508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:46.937933 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a8590006-815c-4f68-83e9-6d64f967fdf5 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1603 microversion: 2.1 time: 0.109498 Jul 13 09:12:46.941397 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 417/804] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:46 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1603 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:47.958409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:47.959185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:47.965723 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:47.966207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:47.967014 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:47.967459 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:48.001403 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:48.003324 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:48.004036 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lazy-loading 'fault' on Instance uuid b0e9d0df-5024-4fa7-8570-1878f7b39d7d {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:12:48.048031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c7c83855084c188ab8a6dacb57a24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9e230019f042dbbc680fc3b1340d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:12:48.056942 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c3ef1e7d-9c0d-484c-ac65-25fb69c378fe tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 200 len: 1324 microversion: 2.1 time: 0.103874 Jul 13 09:12:48.057513 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 388/805] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:47 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 1324 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:12:48.787000 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-6c5275f7-cd07-45eb-b086-8da78c862dd7 req-948417b6-cf55-4ec4-be04-8815d3504d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e9d0df-5024-4fa7-8570-1878f7b39d7d", "name": "network-vif-deleted", "tag": "1cdc3b76-44e3-4767-b0a2-0bb751ae5964"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:12:48.795664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-6c5275f7-cd07-45eb-b086-8da78c862dd7 req-948417b6-cf55-4ec4-be04-8815d3504d14 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:48.796107 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-6c5275f7-cd07-45eb-b086-8da78c862dd7 req-948417b6-cf55-4ec4-be04-8815d3504d14 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:48.807535 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-6c5275f7-cd07-45eb-b086-8da78c862dd7 req-948417b6-cf55-4ec4-be04-8815d3504d14 service nova] Creating event network-vif-deleted:1cdc3b76-44e3-4767-b0a2-0bb751ae5964 for instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d on hv-cinder-84962 Jul 13 09:12:48.812310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-6c5275f7-cd07-45eb-b086-8da78c862dd7 req-948417b6-cf55-4ec4-be04-8815d3504d14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029501 Jul 13 09:12:48.813263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 418/806] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:12:49.074357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:49.074899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:49.081328 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:49.081772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:49.082548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:49.082979 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:49.096550 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] HTTP exception thrown: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Request method failure captured: Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d HTTP/1.1 Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosJL14-Jd669uQ93xCI7Dipg0q3d_SI8GbbqXCrnO-92r1NSd_dpIBEOOMIXGFAPlyc2TevoLVY2e76wfW64RgXFbyIBtpeox706MdRT-gZx1WF09i1UqCJ-35MG67L35BgpdyUSCPkP59078aWJbbxEjsy1YcLYnWKMwGe7Umf0Xk Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:12:49.098318 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 35c7c83855084c188ab8a6dacb57a24b Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:49.099904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'b0e9d0df-5024-4fa7-8570-1878f7b39d7d'} Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:12:49.100987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:49.102520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:49.104193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Returning 404 to user: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:12:49.104193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ecb685e1-989e-46e6-a150-d866966b1e27 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 404 len: 111 microversion: 2.1 time: 0.029400 Jul 13 09:12:49.104193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 389/807] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:49 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:12:49.108893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0fc9c747-1c7a-4f82-82b7-c78ae52da768 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '.version_select at 0x7fad2616aa60>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:49.169915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0fc9c747-1c7a-4f82-82b7-c78ae52da768 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003080" status: 202 len: 0 microversion: 2.1 time: 0.065165 Jul 13 09:12:49.170523 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 419/808] 10.222.0.40 () {58 vars in 1211 bytes} [Wed Jul 13 09:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003080 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:12:52.405092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:52.405594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:52.412783 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:52.413239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:52.414010 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:52.414474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:52.427613 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] HTTP exception thrown: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Request method failure captured: Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d HTTP/1.1 Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosJL14-Jd669uQ93xCI7Dipg0q3d_SI8GbbqXCrnO-92r1NSd_dpIBEOOMIXGFAPlyc2TevoLVY2e76wfW64RgXFbyIBtpeox706MdRT-gZx1WF09i1UqCJ-35MG67L35BgpdyUSCPkP59078aWJbbxEjsy1YcLYnWKMwGe7Umf0Xk Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:12:52.429134 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 35c7c83855084c188ab8a6dacb57a24b Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.430693 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'b0e9d0df-5024-4fa7-8570-1878f7b39d7d'} Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:12:52.431587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.433491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.435275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Returning 404 to user: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:12:52.435275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-73cdb303-e3f7-453f-851c-91cedffd90f4 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 404 len: 111 microversion: 2.1 time: 0.029243 Jul 13 09:12:52.435275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 390/809] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:12:52 2022] DELETE /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:12:52.439360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:52.440101 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: b0e9d0df-5024-4fa7-8570-1878f7b39d7d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:52.447178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:52.447617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:52.448372 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:52.448803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:52.462941 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] HTTP exception thrown: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Request method failure captured: Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d HTTP/1.1 Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosJL14-Jd669uQ93xCI7Dipg0q3d_SI8GbbqXCrnO-92r1NSd_dpIBEOOMIXGFAPlyc2TevoLVY2e76wfW64RgXFbyIBtpeox706MdRT-gZx1WF09i1UqCJ-35MG67L35BgpdyUSCPkP59078aWJbbxEjsy1YcLYnWKMwGe7Umf0Xk Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:12:52.464515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 35c7c83855084c188ab8a6dacb57a24b Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.466061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'b0e9d0df-5024-4fa7-8570-1878f7b39d7d'} Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:12:52.466934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. Jul 13 09:12:52.468215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:52.469438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Returning 404 to user: Instance b0e9d0df-5024-4fa7-8570-1878f7b39d7d could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:12:52.469438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f38b1d70-98db-47b7-a78b-f968b12555b9 tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d" status: 404 len: 111 microversion: 2.1 time: 0.030848 Jul 13 09:12:52.469438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 420/810] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:52 2022] GET /compute/v2.1/servers/b0e9d0df-5024-4fa7-8570-1878f7b39d7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:12:53.737598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:53.738112 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:53.741091 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=62 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:53.745804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:53.746300 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:53.747055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:53.747490 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:53.761730 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] HTTP exception thrown: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Request method failure captured: Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 HTTP/1.1 Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizosJL14-Jd669uQ93xCI7Dipg0q3d_SI8GbbqXCrnO-92r1NSd_dpIBEOOMIXGFAPlyc2TevoLVY2e76wfW64RgXFbyIBtpeox706MdRT-gZx1WF09i1UqCJ-35MG67L35BgpdyUSCPkP59078aWJbbxEjsy1YcLYnWKMwGe7Umf0Xk Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:12:53.763294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 35c7c83855084c188ab8a6dacb57a24b Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.764695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'eb4e5e88-6062-46c0-92b1-4f21fe81b697'} Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:12:53.765472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.766866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.768064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Returning 404 to user: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:12:53.768064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5da2401d-f21b-4c31-8256-47c6abd5fbfb tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 404 len: 111 microversion: 2.1 time: 0.030866 Jul 13 09:12:53.768064 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 391/811] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:12:53 2022] DELETE /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:12:53.772903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:12:53.774365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] [instance: eb4e5e88-6062-46c0-92b1-4f21fe81b697] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:12:53.780027 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:53.780468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:53.781214 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:12:53.781641 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:12:53.785670 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:12:53.795350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] HTTP exception thrown: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Request method failure captured: Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 HTTP/1.1 Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizosJL14-Jd669uQ93xCI7Dipg0q3d_SI8GbbqXCrnO-92r1NSd_dpIBEOOMIXGFAPlyc2TevoLVY2e76wfW64RgXFbyIBtpeox706MdRT-gZx1WF09i1UqCJ-35MG67L35BgpdyUSCPkP59078aWJbbxEjsy1YcLYnWKMwGe7Umf0Xk Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:12:53.796861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb9e230019f042dbbc680fc3b1340d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: eb9e230019f042dbbc680fc3b1340d41 Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239298791 Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 35c7c83855084c188ab8a6dacb57a24b Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeTestJSON-239298791-project Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.798467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'eb4e5e88-6062-46c0-92b1-4f21fe81b697'} Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:12:53.799361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. Jul 13 09:12:53.800680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:12:53.802960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] Returning 404 to user: Instance eb4e5e88-6062-46c0-92b1-4f21fe81b697 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:12:53.802960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3d71a48d-cae0-47d9-94c1-ddf031f0c3ac tempest-AttachVolumeTestJSON-239298791 tempest-AttachVolumeTestJSON-239298791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697" status: 404 len: 111 microversion: 2.1 time: 0.029142 Jul 13 09:12:53.802960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 421/812] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:12:53 2022] GET /compute/v2.1/servers/eb4e5e88-6062-46c0-92b1-4f21fe81b697 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:13:04.325333 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=25 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:04.458104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a25d1b3d-5777-46ef-8a69-63055c87fc3d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: .version_select at 0x7fad216c1c10>, body: {"keypair": {"name": "tempest-keypair-130226329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYjmtRlOKZLAxntGlh8iXtAA/+xzgEy7s/XyMOfR//J9HjEf+0yjAN9j+xYy+spUnKPr+LUGia8IDuRfA/cioG/ZcD9+spr6Z6HDibGLx+Bs6U7x41AwoxVpaYAa6WxBw=="}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:04.479585 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-a25d1b3d-5777-46ef-8a69-63055c87fc3d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:13:04.483762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-a25d1b3d-5777-46ef-8a69-63055c87fc3d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:13:04.571076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a25d1b3d-5777-46ef-8a69-63055c87fc3d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251876 Jul 13 09:13:04.571681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 392/813] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:13:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:07.182211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-169714293", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0419ddd4-ade8-4500-ac9c-4682f59c8496"}], "security_groups": [{"name": "tempest-securitygroup--683615364"}], "key_name": "tempest-keypair-130226329", "user_data": "}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:07.189793 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:07.290362 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] validate_networks() for [('0419ddd4-ade8-4500-ac9c-4682f59c8496', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:13:07.685157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:13:07.685157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:13:07.685157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:13:07.685157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:13:07.685157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:13:07.693413 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:07.693873 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:07.694716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:07.695159 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:07.713452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:13:07.717517 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:13:07.730418 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:13:07.732715 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:13:07.857946 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-45216623-0981-484b-9dc6-1770b6471ff0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680416 Jul 13 09:13:07.861746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 422/814] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:13:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:13:07.869219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-197fce07-3ecb-4368-97f2-b3078056cd2b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:07.869816 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-197fce07-3ecb-4368-97f2-b3078056cd2b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:07.954789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-197fce07-3ecb-4368-97f2-b3078056cd2b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:07.961774 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-197fce07-3ecb-4368-97f2-b3078056cd2b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1240 microversion: 2.1 time: 0.096564 Jul 13 09:13:07.962379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 393/815] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:07 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:08.980679 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:08.981454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:08.988651 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:08.989186 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:08.990899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:08.997017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:09.056615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:09.063934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8c5e46d8-bf48-4606-8101-f17b5afae48c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1244 microversion: 2.1 time: 0.088293 Jul 13 09:13:09.064493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 423/816] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:08 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:10.081593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:10.082329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:10.089092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:10.089550 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:10.090389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:10.090827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:10.366454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:10.374062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0f1831f0-e357-4cb8-ad9c-ebc8811190a1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1310 microversion: 2.1 time: 0.296600 Jul 13 09:13:10.374621 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 394/817] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:10 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:11.331281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:11.331827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:11.339415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:11.340419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:11.341239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:11.341837 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:11.392175 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:11.392959 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:11.400572 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:11.401200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:11.401993 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:11.402456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:11.428619 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lazy-loading 'services' on Instance uuid c14ba4bd-c1b6-4d36-9afb-402a857f32fb {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:13:11.607109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:11.615146 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9ab20352-7e47-4803-b264-27538d9a98fd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.226113 Jul 13 09:13:11.620067 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 395/818] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:11 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:13:11.637975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f1ef457c-3b10-4e06-92aa-d138802ee09d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb/os-volume_attachments/a630545b-7997-4456-8ff6-b413fe04bc8a" status: 202 len: 0 microversion: 2.1 time: 0.310445 Jul 13 09:13:11.645017 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 424/819] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:13:11 2022] DELETE /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb/os-volume_attachments/a630545b-7997-4456-8ff6-b413fe04bc8a => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:13:11.888334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-bc1cd7f6-5206-4f63-91e8-197885dc7c1e req-8216941b-de8e-42f0-b7e9-6da58c9b4cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2037c6-2367-4a79-8c54-1455e09e6280", "tag": "05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:11.901420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-bc1cd7f6-5206-4f63-91e8-197885dc7c1e req-8216941b-de8e-42f0-b7e9-6da58c9b4cc1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:11.901847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-bc1cd7f6-5206-4f63-91e8-197885dc7c1e req-8216941b-de8e-42f0-b7e9-6da58c9b4cc1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:11.914749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-bc1cd7f6-5206-4f63-91e8-197885dc7c1e req-8216941b-de8e-42f0-b7e9-6da58c9b4cc1 service nova] Creating event network-changed:05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7 for instance ec2037c6-2367-4a79-8c54-1455e09e6280 on hv-cinder-84962 Jul 13 09:13:11.919986 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-bc1cd7f6-5206-4f63-91e8-197885dc7c1e req-8216941b-de8e-42f0-b7e9-6da58c9b4cc1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035330 Jul 13 09:13:11.920827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 396/820] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:12.634481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:12.635719 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:12.642061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:12.642522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:12.643281 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:12.643716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:12.787547 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:12.788717 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:12.793686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:12.797711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:12.797711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:12.797711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:12.797711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:12.801813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-72d921ff-2d50-41ef-9c3d-05cd5d8036df tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.172711 Jul 13 09:13:12.803022 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 425/821] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:12 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:12.832962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:13:13.059919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-38ba9deb-927a-4a6d-9a8e-d34254b569ac tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 204 len: 0 microversion: 2.1 time: 0.276265 Jul 13 09:13:13.060448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 397/822] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:13:12 2022] DELETE /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 09:13:13.069185 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:13.069796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:13.075832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:13.076275 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:13.077031 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:13.077459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:13.205399 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:13.212819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e9395e14-24d1-4c22-9e80-49bd80925fd2 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1512 microversion: 2.1 time: 0.148060 Jul 13 09:13:13.213394 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 426/823] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:13 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:13.819796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:13.821109 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:13.827770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:13.828225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:13.829068 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:13.829513 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:13.961449 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:13.968850 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b3baa232-85fe-48e4-83e7-4853567bfcbb tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.153579 Jul 13 09:13:13.969435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 398/824] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:13 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:14.229846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:14.230417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:14.236765 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:14.237209 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:14.237958 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:14.238416 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:14.366184 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:14.373606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1472bf22-a3b6-4094-848c-fa7af617a856 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1512 microversion: 2.1 time: 0.147650 Jul 13 09:13:14.374196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 427/825] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:14 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:14.986695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:14.987219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:14.994538 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:14.994988 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:14.995745 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:14.996178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:15.121940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:15.129225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6e50ad7c-e0bd-4ebe-8a8a-07c75ed806b3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.146529 Jul 13 09:13:15.129781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 399/826] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:14 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:15.391076 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:15.400244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:15.400244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:15.400244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:15.400244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:15.400653 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:15.540626 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:15.548341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-52681348-967f-4090-9c1c-bee8246b1643 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1512 microversion: 2.1 time: 0.161137 Jul 13 09:13:15.548911 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 428/827] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:15 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:16.151085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:16.151701 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:16.151883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-9ff562fa-882f-4c8d-9b9a-463615883b57 req-1d0a9c84-018c-43d6-b9f0-21b7837e9fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14ba4bd-c1b6-4d36-9afb-402a857f32fb", "name": "network-vif-deleted", "tag": "fc7c7334-df17-4f9d-8b8d-0c8311d44d09"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:16.158495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:16.183159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:16.183159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:16.183400 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9ff562fa-882f-4c8d-9b9a-463615883b57 req-1d0a9c84-018c-43d6-b9f0-21b7837e9fe0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:16.183510 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:16.183594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-9ff562fa-882f-4c8d-9b9a-463615883b57 req-1d0a9c84-018c-43d6-b9f0-21b7837e9fe0 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:16.183594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-9ff562fa-882f-4c8d-9b9a-463615883b57 req-1d0a9c84-018c-43d6-b9f0-21b7837e9fe0 service nova] Creating event network-vif-deleted:fc7c7334-df17-4f9d-8b8d-0c8311d44d09 for instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb on hv-cinder-84962 Jul 13 09:13:16.183594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-9ff562fa-882f-4c8d-9b9a-463615883b57 req-1d0a9c84-018c-43d6-b9f0-21b7837e9fe0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Jul 13 09:13:16.183594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 429/828] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:13:16.349520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:16.357753 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5afc5117-c463-450b-9f48-b6e4a77dccbd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.215590 Jul 13 09:13:16.358344 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 400/829] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:16 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:16.565996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:16.566730 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:16.573210 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:16.573653 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:16.574443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:16.574880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:16.606142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:16.606607 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:16.607046 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lazy-loading 'fault' on Instance uuid c14ba4bd-c1b6-4d36-9afb-402a857f32fb {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:13:16.652239 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:16.659853 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e1f5df01-a159-4646-b77a-6f5b44d6f3e3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 200 len: 1308 microversion: 2.1 time: 0.098593 Jul 13 09:13:16.660415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 430/830] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:16 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:17.374314 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:17.374926 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:17.381285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:17.383731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:17.384509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:17.384944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:17.524516 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:17.531910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a18dd394-e694-4e2d-8acd-d529ef8a98a7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.161486 Jul 13 09:13:17.532464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 401/831] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:17 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:17.677865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:17.678944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: c14ba4bd-c1b6-4d36-9afb-402a857f32fb] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:17.685630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:17.686102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:17.686885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:17.687316 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:17.701257 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] HTTP exception thrown: Instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb could not be found. Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Request method failure captured: Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb HTTP/1.1 Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoxeqxohC2DB0jhWFS8uFAlZo2FdBbjSxZQQXPW4DMeght-vPkQCOj4cD2yQ3r4anyQpjLvkSOIzoMAZ_oe35QdsSOLSUVOpW35HF4t058l8U6t1XilUFJOKeUryYii4VQxpY6lKhvBYUQs-zYTEfPnkGXoV9HESGLGbiEfZMoUWWIU Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 2362e98f5387452893f972175548189a Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347448595 Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:13:17.702909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2362e98f5387452893f972175548189a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2362e98f5387452893f972175548189a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2362e98f5387452893f972175548189a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2362e98f5387452893f972175548189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesSnapshotTestJSON-347448595 Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 2362e98f5387452893f972175548189a Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347448595 Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesSnapshotTestJSON-347448595-project Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 8ff085ab5e6d4d278b72b7b8c528c8d4 Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesSnapshotTestJSON-347448595-project Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb could not be found. Jul 13 09:13:17.704507 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'c14ba4bd-c1b6-4d36-9afb-402a857f32fb'} Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb could not be found. Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:13:17.705588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb could not be found. Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb could not be found. Jul 13 09:13:17.707096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:17.708452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Returning 404 to user: Instance c14ba4bd-c1b6-4d36-9afb-402a857f32fb could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:13:17.708452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2d64979f-4cb4-4f1b-b5df-21199b7f5780 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb" status: 404 len: 111 microversion: 2.1 time: 0.030349 Jul 13 09:13:17.708452 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 431/832] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:17 2022] GET /compute/v2.1/servers/c14ba4bd-c1b6-4d36-9afb-402a857f32fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:13:18.548615 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:18.549161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:18.551130 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:18.556413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:18.556861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:18.557622 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:18.558072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:18.688662 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:18.696661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b72fced5-1b56-4042-a4d9-8e7d6f6e6cce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.151994 Jul 13 09:13:18.699641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 402/833] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:18 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:13:19.713263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:19.713896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:19.715841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:19.716490 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:19.721738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:19.722220 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:19.722978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:19.723407 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:19.851001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:19.858279 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6c4db498-577c-4a75-933a-0eaf68efda00 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.148894 Jul 13 09:13:19.858836 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 432/834] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:19 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:20.189639 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-a66e20c3-e1aa-4895-83f8-ea146d00db84 req-cf6ed06c-2cd1-4d19-a4ad-968387d16d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2037c6-2367-4a79-8c54-1455e09e6280", "name": "network-vif-plugged", "status": "completed", "tag": "05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:20.198682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-a66e20c3-e1aa-4895-83f8-ea146d00db84 req-cf6ed06c-2cd1-4d19-a4ad-968387d16d2b service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:20.199128 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-a66e20c3-e1aa-4895-83f8-ea146d00db84 req-cf6ed06c-2cd1-4d19-a4ad-968387d16d2b service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:20.210534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-a66e20c3-e1aa-4895-83f8-ea146d00db84 req-cf6ed06c-2cd1-4d19-a4ad-968387d16d2b service nova] Creating event network-vif-plugged:05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7 for instance ec2037c6-2367-4a79-8c54-1455e09e6280 on hv-cinder-84962 Jul 13 09:13:20.215681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-a66e20c3-e1aa-4895-83f8-ea146d00db84 req-cf6ed06c-2cd1-4d19-a4ad-968387d16d2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 Jul 13 09:13:20.216251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 403/835] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:20.875085 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:20.875702 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:20.883417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:20.884350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:20.885253 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:20.885700 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:21.027363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:21.034859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7a2fe165-bc91-40b5-9670-77c64f7e4b46 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.163764 Jul 13 09:13:21.035470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 433/836] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:20 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:13:22.053479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:22.054793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:22.061029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.061472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.062268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.062715 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.200736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:22.208280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2d2e6b34-6ae8-4c56-9cbe-640b31d0a38b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1365 microversion: 2.1 time: 0.159457 Jul 13 09:13:22.208877 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 404/837] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:22 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:22.456595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:22.457574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:22.464295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.464733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.465473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.465925 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.495043 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-516b02a7-f7da-4ef5-a431-642c42126e8e tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042502 Jul 13 09:13:22.495595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 434/838] 10.222.0.40 () {60 vars in 1342 bytes} [Wed Jul 13 09:13:22 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:22.558123 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:22.558731 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:22.564710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.565261 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.566108 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.566630 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.592465 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:13:22.859159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a74a116f-95c1-472b-8007-bade15867861 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 204 len: 0 microversion: 2.20 time: 0.303897 Jul 13 09:13:22.859944 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 405/839] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Jul 13 09:13:22 2022] DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 09:13:22.867884 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:22.869145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:22.875184 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.875625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:22.876363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:22.876789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:23.010312 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:23.018320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:23.019813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:23.020983 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9e7be897-2825-4f0e-97cd-8f3805009910 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.156974 Jul 13 09:13:23.021541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 435/840] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:22 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:13:23.226265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:23.226967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:23.234086 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:23.234542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:23.235305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:23.235745 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:23.363045 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:23.371258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bbd0fe3f-015a-4876-9ee2-3d0851e72089 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1554 microversion: 2.1 time: 0.149227 Jul 13 09:13:23.371824 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 406/841] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:23 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:23.387645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:23.388134 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:23.393996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:23.394462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:23.395215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:23.395639 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:23.470385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c190c28a-9a1e-4d9c-9d6a-5c4e6ee41aa8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086620 Jul 13 09:13:23.470978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 436/842] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:13:23 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:24.038420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:24.039022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:24.044992 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:24.049398 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:24.049398 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:24.049398 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:24.174810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:24.182766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:24.184273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:24.185413 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b4866e3b-c9b5-4e7b-9652-b4273ab85f70 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.150928 Jul 13 09:13:24.185963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 407/843] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:24 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:13:24.503796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-bd68c06a-0ba0-4314-bf22-416b527b56da req-4b710472-b844-4cf3-915a-353b9d13cfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2037c6-2367-4a79-8c54-1455e09e6280", "tag": "05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:24.513142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-bd68c06a-0ba0-4314-bf22-416b527b56da req-4b710472-b844-4cf3-915a-353b9d13cfe4 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:24.518216 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-bd68c06a-0ba0-4314-bf22-416b527b56da req-4b710472-b844-4cf3-915a-353b9d13cfe4 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:24.525483 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-bd68c06a-0ba0-4314-bf22-416b527b56da req-4b710472-b844-4cf3-915a-353b9d13cfe4 service nova] Creating event network-changed:05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7 for instance ec2037c6-2367-4a79-8c54-1455e09e6280 on hv-cinder-84962 Jul 13 09:13:24.531223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-bd68c06a-0ba0-4314-bf22-416b527b56da req-4b710472-b844-4cf3-915a-353b9d13cfe4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031557 Jul 13 09:13:24.531859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 437/844] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:25.203677 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:25.204338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:25.210878 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:25.211335 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:25.212144 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:25.212588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:25.230985 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:25.351136 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:25.359946 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:25.361478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:25.362673 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9363dfd6-6884-4d27-89b0-feb763e2a165 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.162993 Jul 13 09:13:25.363236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 408/845] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:25 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:13:26.381704 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:26.382444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:26.389585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:26.390062 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:26.390829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:26.391271 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:26.526397 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:26.534955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:26.536480 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:26.537650 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-89413318-794a-4f64-a323-4ec36ed574fe tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1724 microversion: 2.20 time: 0.160694 Jul 13 09:13:26.538247 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 438/846] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:26 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:13:27.137272 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1838208139", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "networks": [{"uuid": "8a64382d-2c78-430f-8ebf-0370d8f9f1b4"}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:27.186677 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] validate_networks() for [('8a64382d-2c78-430f-8ebf-0370d8f9f1b4', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:13:27.557590 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:27.558378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:27.565923 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:27.566655 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:27.567854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:27.568460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:27.637685 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:27.645959 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:27.648455 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1438ef91441f4493844a915ce12fcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b63eccabbc498cb96dd4bbcef0969a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:27.648646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4644d9b0-eec8-43da-a07f-2f60479cca55 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 200 len: 1657 microversion: 2.20 time: 0.096615 Jul 13 09:13:27.649318 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 439/847] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:27 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 1657 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 09:13:27.826167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-564fa279-137f-441c-ad24-0295e294db70 req-e10d445d-ecbf-41e1-8fdc-84ad5ac70a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa", "name": "network-vif-deleted", "tag": "b9499393-8a91-40ba-8695-6c191d7d0d9d"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:27.835657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-564fa279-137f-441c-ad24-0295e294db70 req-e10d445d-ecbf-41e1-8fdc-84ad5ac70a03 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:27.836353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-564fa279-137f-441c-ad24-0295e294db70 req-e10d445d-ecbf-41e1-8fdc-84ad5ac70a03 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:27.850678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-564fa279-137f-441c-ad24-0295e294db70 req-e10d445d-ecbf-41e1-8fdc-84ad5ac70a03 service nova] Creating event network-vif-deleted:b9499393-8a91-40ba-8695-6c191d7d0d9d for instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa on hv-cinder-84962 Jul 13 09:13:27.857108 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-564fa279-137f-441c-ad24-0295e294db70 req-e10d445d-ecbf-41e1-8fdc-84ad5ac70a03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035929 Jul 13 09:13:27.858150 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 440/848] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:13:27.958521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:13:27.958945 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:13:27.959448 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:13:27.959853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:13:27.960305 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:13:27.970582 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:27.971066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:27.971858 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:27.972295 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:27.989655 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Getting quotas for project 2362e98f5387452893f972175548189a. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:13:27.995370 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Getting quotas for user 8ff085ab5e6d4d278b72b7b8c528c8d4 and project 2362e98f5387452893f972175548189a. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:13:28.010894 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:13:28.013840 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:13:28.136619 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ec700a49-80a1-4fe2-933b-7990d4e69081 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012803 Jul 13 09:13:28.137441 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 409/849] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:13:28.153489 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-94737e7f-0d7c-4e45-afb3-4249a9bac334 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:28.154219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-94737e7f-0d7c-4e45-afb3-4249a9bac334 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:28.215179 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-94737e7f-0d7c-4e45-afb3-4249a9bac334 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:28.224042 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-94737e7f-0d7c-4e45-afb3-4249a9bac334 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1219 microversion: 2.1 time: 0.073977 Jul 13 09:13:28.224865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 441/850] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:28 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:28.668802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:28.669341 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:28.676573 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:28.677026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:28.677801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:28.678444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:28.692678 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] HTTP exception thrown: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Request method failure captured: Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa HTTP/1.1 Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor-c4aVWqTR_Kcr2AJOrmmYofeY56lR7VDgGrPNrySk-FP6yG84zWLt1IVDw6JJ2VJ2pf_JGTP4XarrfpQKjVKaVVvZ-tunisyLiN0eKtUSGTgVUyZNOv5MAWOenknszs3Wo8Z3q-nCef4g_548_hgS1s_pjeA0DUZxeBtlJOBaGWs Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:13:28.694392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 1438ef91441f4493844a915ce12fcfa4 Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:28.695899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa'} Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:13:28.696719 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:28.698169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:28.699569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Returning 404 to user: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:13:28.699569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-31d7f06b-601b-433f-9b04-147ae9ff1e8c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 404 len: 111 microversion: 2.20 time: 0.032263 Jul 13 09:13:28.699569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 410/851] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:28 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:13:28.706121 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2a2ec177-5c62-445f-8987-f78958be91ba tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '.version_select at 0x7fad260e3a60>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:28.809936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2a2ec177-5c62-445f-8987-f78958be91ba tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156304271" status: 204 len: 0 microversion: 2.20 time: 0.108137 Jul 13 09:13:28.810720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 442/852] 10.222.0.40 () {60 vars in 1261 bytes} [Wed Jul 13 09:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156304271 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 09:13:29.246077 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:29.246729 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:29.252941 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:29.253400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:29.254202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:29.254646 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:29.333835 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:29.343396 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-33cbaaff-05ad-4866-852a-4c0b7462b6b8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1215 microversion: 2.1 time: 0.101204 Jul 13 09:13:29.343923 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 411/853] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:29 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:30.361238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:30.363159 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:30.369298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:30.369676 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:30.370468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:30.370901 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:30.375086 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:30.432894 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:30.440298 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6ac8fb89-82fb-464c-99ee-fb70ed832b57 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1277 microversion: 2.1 time: 0.083569 Jul 13 09:13:30.443457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 443/854] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:30 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:30.841681 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:30.842242 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:30.848733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:30.849177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:30.850056 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:30.852060 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:30.864404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] HTTP exception thrown: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Request method failure captured: Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa HTTP/1.1 Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor-c4aVWqTR_Kcr2AJOrmmYofeY56lR7VDgGrPNrySk-FP6yG84zWLt1IVDw6JJ2VJ2pf_JGTP4XarrfpQKjVKaVVvZ-tunisyLiN0eKtUSGTgVUyZNOv5MAWOenknszs3Wo8Z3q-nCef4g_548_hgS1s_pjeA0DUZxeBtlJOBaGWs Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:13:30.865949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 1438ef91441f4493844a915ce12fcfa4 Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.867762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa'} Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:13:30.868739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.870342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.872042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Returning 404 to user: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:13:30.872042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4b6541a9-b224-4249-8d81-3d1867be29c0 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 404 len: 111 microversion: 2.20 time: 0.030459 Jul 13 09:13:30.872042 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 412/855] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Jul 13 09:13:30 2022] DELETE /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:13:30.876974 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:30.877663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:30.885496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:30.886015 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:30.886888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:30.887402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:30.903420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] HTTP exception thrown: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Request method failure captured: Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa HTTP/1.1 Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor-c4aVWqTR_Kcr2AJOrmmYofeY56lR7VDgGrPNrySk-FP6yG84zWLt1IVDw6JJ2VJ2pf_JGTP4XarrfpQKjVKaVVvZ-tunisyLiN0eKtUSGTgVUyZNOv5MAWOenknszs3Wo8Z3q-nCef4g_548_hgS1s_pjeA0DUZxeBtlJOBaGWs Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:13:30.905113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 1438ef91441f4493844a915ce12fcfa4 Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.906703 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa'} Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:13:30.907565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. Jul 13 09:13:30.910233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:30.916444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Returning 404 to user: Instance fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:13:30.916444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f4e8c922-adc2-4988-bb86-94c2cb48c6b9 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa" status: 404 len: 111 microversion: 2.20 time: 0.034112 Jul 13 09:13:30.916444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 444/856] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:30 2022] GET /compute/v2.1/servers/fd9fb7b6-4fd2-4b2c-92c6-45b4a80a2aaa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:13:31.457503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:31.457635 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:31.463930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:31.464386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:31.465157 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:31.465597 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:31.615801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:31.624038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6eadb2d6-5ecf-4151-9f2a-b3a50ae31a1a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.171277 Jul 13 09:13:31.624586 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 413/857] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:31 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:31.684153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-68295e8a-27f0-44be-935c-0c8345554a42 req-04046cda-76a8-4638-8546-e712582cf231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a6705c-54ea-47fa-bd38-808adfa5851c", "tag": "aee42f0f-6e77-480e-b3b1-decd7db2a61a"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:31.694581 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-68295e8a-27f0-44be-935c-0c8345554a42 req-04046cda-76a8-4638-8546-e712582cf231 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:31.695123 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-68295e8a-27f0-44be-935c-0c8345554a42 req-04046cda-76a8-4638-8546-e712582cf231 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:31.706995 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-68295e8a-27f0-44be-935c-0c8345554a42 req-04046cda-76a8-4638-8546-e712582cf231 service nova] Creating event network-changed:aee42f0f-6e77-480e-b3b1-decd7db2a61a for instance 70a6705c-54ea-47fa-bd38-808adfa5851c on hv-cinder-84962 Jul 13 09:13:31.711694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-68295e8a-27f0-44be-935c-0c8345554a42 req-04046cda-76a8-4638-8546-e712582cf231 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Jul 13 09:13:31.712457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 445/858] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:32.216169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:32.216658 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:32.223592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:32.224053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:32.225422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:32.225873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:32.239548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] HTTP exception thrown: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Request method failure captured: Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 HTTP/1.1 Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizor-c4aVWqTR_Kcr2AJOrmmYofeY56lR7VDgGrPNrySk-FP6yG84zWLt1IVDw6JJ2VJ2pf_JGTP4XarrfpQKjVKaVVvZ-tunisyLiN0eKtUSGTgVUyZNOv5MAWOenknszs3Wo8Z3q-nCef4g_548_hgS1s_pjeA0DUZxeBtlJOBaGWs Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:13:32.241030 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 1438ef91441f4493844a915ce12fcfa4 Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.242714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'f7bcc760-4b60-4bfc-bd63-33c070d886b6'} Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:13:32.243887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.245421 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.247361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Returning 404 to user: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:13:32.247361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-447f04f9-f47c-4c4c-830a-45d98e33120c tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 404 len: 111 microversion: 2.20 time: 0.030927 Jul 13 09:13:32.247361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 414/859] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Jul 13 09:13:32 2022] DELETE /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:13:32.252669 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:32.253482 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] [instance: f7bcc760-4b60-4bfc-bd63-33c070d886b6] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:32.260914 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:32.261360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:32.262150 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:32.262589 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:32.276382 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] HTTP exception thrown: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Request method failure captured: Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 HTTP/1.1 Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizor-c4aVWqTR_Kcr2AJOrmmYofeY56lR7VDgGrPNrySk-FP6yG84zWLt1IVDw6JJ2VJ2pf_JGTP4XarrfpQKjVKaVVvZ-tunisyLiN0eKtUSGTgVUyZNOv5MAWOenknszs3Wo8Z3q-nCef4g_548_hgS1s_pjeA0DUZxeBtlJOBaGWs Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Openstack-Nova-Api-Version: 2.20 Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:13:32.278011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09b63eccabbc498cb96dd4bbcef0969a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 09b63eccabbc498cb96dd4bbcef0969a Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-747678042 Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 1438ef91441f4493844a915ce12fcfa4 Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeShelveTestJSON-747678042-project Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.279616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'f7bcc760-4b60-4bfc-bd63-33c070d886b6'} Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:13:32.280381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. Jul 13 09:13:32.281559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:13:32.282678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] Returning 404 to user: Instance f7bcc760-4b60-4bfc-bd63-33c070d886b6 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:13:32.282678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1332a709-f599-4897-aba6-c9b76abc7a92 tempest-AttachVolumeShelveTestJSON-747678042 tempest-AttachVolumeShelveTestJSON-747678042-project] 10.222.0.40 "GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6" status: 404 len: 111 microversion: 2.20 time: 0.031072 Jul 13 09:13:32.282678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 446/860] 10.222.0.40 () {60 vars in 1276 bytes} [Wed Jul 13 09:13:32 2022] GET /compute/v2.1/servers/f7bcc760-4b60-4bfc-bd63-33c070d886b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:13:32.640859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:32.641534 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:32.647545 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:32.647989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:32.648745 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:32.649171 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:32.782560 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:32.791137 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1bbf40fa-11de-48b3-bc98-aa66f1086bc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.153378 Jul 13 09:13:32.791779 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 415/861] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:32 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:33.808565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:33.809195 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:33.815746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:33.816191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:33.816978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:33.817376 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:34.008638 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:34.017844 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b52f4422-08b0-438e-b635-81bab70d981f tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.213531 Jul 13 09:13:34.018532 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 447/862] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:33 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:35.035167 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:35.036368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:35.039196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:35.045515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:35.046268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:35.047053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:35.047652 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:35.198217 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:35.205844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f442e765-1148-4101-a0e9-07955a604ec7 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.175443 Jul 13 09:13:35.210452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 416/863] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:35 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:36.223255 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:36.223819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:36.231129 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:36.231584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:36.232360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:36.232803 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:36.379336 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:36.388663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-376351d6-be6f-497a-8e1b-cd68011d802c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.168704 Jul 13 09:13:36.389528 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 448/864] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:36 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:37.172381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-987bd0f0-3ace-4afe-93b3-b98e2a06d04c req-9a32bac3-b0d7-4780-ba25-5f3d3ee67bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a6705c-54ea-47fa-bd38-808adfa5851c", "name": "network-vif-plugged", "status": "completed", "tag": "aee42f0f-6e77-480e-b3b1-decd7db2a61a"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:37.182104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-987bd0f0-3ace-4afe-93b3-b98e2a06d04c req-9a32bac3-b0d7-4780-ba25-5f3d3ee67bea service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:37.182550 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-987bd0f0-3ace-4afe-93b3-b98e2a06d04c req-9a32bac3-b0d7-4780-ba25-5f3d3ee67bea service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:37.193587 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-987bd0f0-3ace-4afe-93b3-b98e2a06d04c req-9a32bac3-b0d7-4780-ba25-5f3d3ee67bea service nova] Creating event network-vif-plugged:aee42f0f-6e77-480e-b3b1-decd7db2a61a for instance 70a6705c-54ea-47fa-bd38-808adfa5851c on hv-cinder-84962 Jul 13 09:13:37.199268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-987bd0f0-3ace-4afe-93b3-b98e2a06d04c req-9a32bac3-b0d7-4780-ba25-5f3d3ee67bea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 Jul 13 09:13:37.205290 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 417/865] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:13:37.407102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:37.407102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:37.408596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:37.413553 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:37.414002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:37.414799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:37.415821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:37.547222 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:37.555062 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5a1afabe-28da-40e8-9628-ac9c771739c3 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.153548 Jul 13 09:13:37.558792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 449/866] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:37 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:38.574004 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:38.574644 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:38.576844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:38.577551 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:38.582637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:38.583111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:38.583865 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:38.584295 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:38.715878 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:38.723575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1f50f852-d33d-4718-a27c-2cc58773e345 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1319 microversion: 2.1 time: 0.154944 Jul 13 09:13:38.724142 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 418/867] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:38 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:39.740947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:13:39.741541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:39.743337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:13:39.748578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:39.749020 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:39.749821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:39.750240 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:39.879201 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:13:39.887442 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e3a43e9a-5b9c-4ed1-8f35-c7ad5c4f05de tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1506 microversion: 2.1 time: 0.150850 Jul 13 09:13:39.888009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 450/868] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:13:39 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:13:39.904186 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d604a51-d0c3-4c0a-971b-4499ad5bc6a4", "device": "/dev/sdb"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:13:39.905770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:13:39.912194 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:39.912641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:39.913400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:13:39.913837 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:13:40.612239 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6a0683df-0647-412e-9d93-e5d23230cfc6 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "POST /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712387 Jul 13 09:13:40.612977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 419/869] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:13:39 2022] POST /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:00.396080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:00.396633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:00.399297 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:00.408046 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=34 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:00.413560 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:00.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:00.414808 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:00.415243 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:00.504378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lazy-loading 'services' on Instance uuid 70a6705c-54ea-47fa-bd38-808adfa5851c {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:14:00.709829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bbf8be39-edb7-4348-9ea3-b1eb509b07a8 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c/os-volume_attachments/3d604a51-d0c3-4c0a-971b-4499ad5bc6a4" status: 202 len: 0 microversion: 2.1 time: 0.323229 Jul 13 09:14:00.710459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 451/870] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:14:00 2022] DELETE /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c/os-volume_attachments/3d604a51-d0c3-4c0a-971b-4499ad5bc6a4 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:14:01.833611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=7 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:01.834423 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:01.838447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:01.839031 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:01.846009 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:01.846475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:01.848799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:01.848799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:01.877040 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:14:02.168356 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a10c5b73-d1e0-4647-83b8-a52204c22d9d tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 204 len: 0 microversion: 2.1 time: 0.336002 Jul 13 09:14:02.173355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 420/871] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:14:01 2022] DELETE /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:14:02.179330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:02.180526 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:02.196158 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:02.196621 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:02.197409 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:02.197909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:02.333904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:02.342251 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-915cb8f8-46e5-4429-b43a-4221b9e3780c tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1512 microversion: 2.1 time: 0.167828 Jul 13 09:14:02.342838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 452/872] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:02 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:03.366382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:03.366382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:03.371867 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:03.372322 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:03.373348 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:03.373715 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:03.511174 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:03.521732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-998df4b7-910f-4d45-a39a-b90dfe1ce663 tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1512 microversion: 2.1 time: 0.161440 Jul 13 09:14:03.526895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 421/873] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:03 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:04.397391 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-4dd436ae-99f6-4411-a26b-8d513b52299f req-c28121cd-9daa-4e63-98f7-2d232e006b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a6705c-54ea-47fa-bd38-808adfa5851c", "name": "network-vif-deleted", "tag": "aee42f0f-6e77-480e-b3b1-decd7db2a61a"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:04.406451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-4dd436ae-99f6-4411-a26b-8d513b52299f req-c28121cd-9daa-4e63-98f7-2d232e006b59 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:04.413904 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-4dd436ae-99f6-4411-a26b-8d513b52299f req-c28121cd-9daa-4e63-98f7-2d232e006b59 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:04.418415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-4dd436ae-99f6-4411-a26b-8d513b52299f req-c28121cd-9daa-4e63-98f7-2d232e006b59 service nova] Creating event network-vif-deleted:aee42f0f-6e77-480e-b3b1-decd7db2a61a for instance 70a6705c-54ea-47fa-bd38-808adfa5851c on hv-cinder-84962 Jul 13 09:14:04.423846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-4dd436ae-99f6-4411-a26b-8d513b52299f req-c28121cd-9daa-4e63-98f7-2d232e006b59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Jul 13 09:14:04.424576 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 453/874] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:04.538672 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:04.539297 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:04.546789 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:04.547277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:04.548038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:04.548471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:04.864737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff085ab5e6d4d278b72b7b8c528c8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2362e98f5387452893f972175548189a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:04.872317 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3c6a3fdf-fb5c-4a90-a4e2-5661a2acff5a tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 200 len: 1304 microversion: 2.1 time: 0.337698 Jul 13 09:14:04.873010 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 422/875] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:04 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 1304 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:05.890330 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:05.890974 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] [instance: 70a6705c-54ea-47fa-bd38-808adfa5851c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:05.897560 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:05.898012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:05.898809 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:05.899249 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:05.913003 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] HTTP exception thrown: Instance 70a6705c-54ea-47fa-bd38-808adfa5851c could not be found. Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Request method failure captured: Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c HTTP/1.1 Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoxeqxohC2DB0jhWFS8uFAlZo2FdBbjSxZQQXPW4DMeght-vPkQCOj4cD2yQ3r4anyQpjLvkSOIzoMAZ_oe35QdsSOLSUVOpW35HF4t058l8U6t1XilUFJOKeUryYii4VQxpY6lKhvBYUQs-zYTEfPnkGXoV9HESGLGbiEfZMoUWWIU Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 2362e98f5387452893f972175548189a Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347448595 Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:14:05.914727 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2362e98f5387452893f972175548189a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2362e98f5387452893f972175548189a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2362e98f5387452893f972175548189a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2362e98f5387452893f972175548189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesSnapshotTestJSON-347448595 Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 2362e98f5387452893f972175548189a Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347448595 Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesSnapshotTestJSON-347448595-project Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 8ff085ab5e6d4d278b72b7b8c528c8d4 Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesSnapshotTestJSON-347448595-project Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 70a6705c-54ea-47fa-bd38-808adfa5851c could not be found. Jul 13 09:14:05.916367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '70a6705c-54ea-47fa-bd38-808adfa5851c'} Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a6705c-54ea-47fa-bd38-808adfa5851c could not be found. Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:14:05.917305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a6705c-54ea-47fa-bd38-808adfa5851c could not be found. Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a6705c-54ea-47fa-bd38-808adfa5851c could not be found. Jul 13 09:14:05.918710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:14:05.919865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] Returning 404 to user: Instance 70a6705c-54ea-47fa-bd38-808adfa5851c could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:14:05.919865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-88d8133e-7905-4d31-80bc-8bfd40f76bbf tempest-VolumesSnapshotTestJSON-347448595 tempest-VolumesSnapshotTestJSON-347448595-project] 10.222.0.40 "GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c" status: 404 len: 111 microversion: 2.1 time: 0.030797 Jul 13 09:14:05.919865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 454/876] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:05 2022] GET /compute/v2.1/servers/70a6705c-54ea-47fa-bd38-808adfa5851c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:14:07.945971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:07.946535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:07.953482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:07.953932 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:07.954711 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:07.955147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:07.978516 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-071d7489-af77-428e-b03c-bc93e0ec872e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/ips" status: 200 len: 148 microversion: 2.1 time: 0.036446 Jul 13 09:14:07.979090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 423/877] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:14:07 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:12.481645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:12.482214 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:12.489510 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:12.496859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:12.496859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:12.496859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:12.519869 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lazy-loading 'flavor' on Instance uuid d44bf150-cda8-482a-a0b9-f51d8070d972 {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:14:12.800458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7f5f7038-6694-4b61-baa6-5dc58b9860bc tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "POST /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972/action" status: 202 len: 0 microversion: 2.1 time: 0.322791 Jul 13 09:14:12.800965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 455/878] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:14:12 2022] POST /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:14:12.809281 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:12.809900 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:12.817365 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:12.817967 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:12.818770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:12.819212 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:12.951586 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:12.959085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-12df3881-eaee-42ca-b792-7992ca7cabc5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.153722 Jul 13 09:14:12.959641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 424/879] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:12 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:13.977206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:13.980722 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:13.985383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:13.985837 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:13.986623 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:13.987055 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:14.124740 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:14.132517 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5d94bb13-6c32-4a59-9eaf-0b784515bc6b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.159247 Jul 13 09:14:14.133080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 456/880] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:13 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:14.863160 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0b68cac-7b93-4ca8-9434-a85ed51249f4"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:14.864219 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:14.870700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:14.871140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:14.871892 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:14.872319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:15.149802 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:15.150365 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:15.157487 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:15.157940 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:15.158733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:15.159194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:15.286759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:15.294256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0af0e32f-a424-4102-b513-79bd4f354b3f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.148448 Jul 13 09:14:15.294827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 457/881] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:15 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:16.311320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:16.311938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:16.319143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:16.319590 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:16.320353 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:16.320791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:16.448755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:16.456166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-be367ee6-eccd-4533-9ebc-612b584fa418 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.148694 Jul 13 09:14:16.456724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 458/882] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:16 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:17.223246 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3c79ef3e-8b14-415c-8f4b-97ceca643ef6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.363878 Jul 13 09:14:17.224065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 425/883] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:14:14 2022] POST /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments => generated 194 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:17.476453 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:17.477363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:17.484262 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:17.484706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:17.486336 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:17.486818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:17.623019 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:17.630678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-dba671c4-09aa-4d44-9468-efc840b07361 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.158126 Jul 13 09:14:17.631308 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 459/884] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:17 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:18.648805 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:18.649514 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:18.656553 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:18.657026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:18.657992 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:18.658461 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:18.805503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:18.814735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f835935a-9b95-451c-bc16-352bfaf93dcd tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.170231 Jul 13 09:14:18.815476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 426/885] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:18 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:19.832326 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:19.832934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:19.839310 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:19.839751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:19.840499 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:19.840939 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:19.971536 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:19.979136 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-fb392a41-dedf-4583-a6a1-a6d7c0d48dd5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.151051 Jul 13 09:14:19.979701 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 460/886] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:19 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:20.996037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:20.996768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:21.004431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:21.004881 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:21.005646 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:21.006106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:21.140594 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:21.153114 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d0921920-c075-4f18-8ae2-69c1ed9d9b73 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.160997 Jul 13 09:14:21.153821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 427/887] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:20 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:22.171131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:22.171868 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:22.178952 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:22.179420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:22.180166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:22.180600 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:22.311364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:22.318871 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1f4a2590-32ae-4fc8-85e9-733d5fa59008 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.151656 Jul 13 09:14:22.319445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 461/888] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:22 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:23.335680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:23.336364 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:23.343925 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:23.344127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:23.345437 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:23.345925 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:23.479926 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:23.488209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-752d4317-f596-4507-a9bb-b6798054f0b5 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.156296 Jul 13 09:14:23.488783 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 428/889] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:23 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:24.507385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:24.508024 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:24.514916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:24.515371 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:24.516137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:24.516620 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:24.665153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:24.668083 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1ac93119-daa1-4e3f-8c5a-2787b3c6624f tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.165238 Jul 13 09:14:24.668722 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 462/890] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:24 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:25.685881 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:25.701145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:25.701145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:25.701145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:25.701145 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:25.701847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:25.791676 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6b70e837-6f29-45c1-b0a8-9c63490cb014 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: .version_select at 0x7fad26105af0>, body: {"keypair": {"name": "tempest-keypair-1026774852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYa+SiM3OjdkVXUt2CcTQzRuMzW7bpj1eFPzZoskK2Xdx2AIQT0b5sNYnH9zcYVIJtFmqVISsLgIVDJiqgJyhZZI+wRfTpHDMRwCeWWm/CVewZHl8pZ4YnfTJLKFjtDQg=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:25.810614 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-6b70e837-6f29-45c1-b0a8-9c63490cb014 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:14:25.814889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-6b70e837-6f29-45c1-b0a8-9c63490cb014 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:14:25.835919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:25.842319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e55e5fff-d1ba-4fd7-ac61-8313da3d6558 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.160136 Jul 13 09:14:25.842882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 429/891] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:25 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:25.889081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6b70e837-6f29-45c1-b0a8-9c63490cb014 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101127 Jul 13 09:14:25.889753 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 463/892] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:14:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:14:26.860085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:26.861312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:26.869147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:26.869864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:26.870735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:26.871287 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:27.035231 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:27.042933 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-29384b9f-75ce-465c-88d6-18b430d35c1e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.186794 Jul 13 09:14:27.043500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 430/893] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:26 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:28.061994 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:28.064261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:28.083640 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:28.084084 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:28.084854 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:28.085290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:28.220072 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:28.228370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ae72f1c5-c9bb-4862-878e-4e5b428de830 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.171405 Jul 13 09:14:28.228943 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 464/894] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:28 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:28.328673 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-205295488", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0419ddd4-ade8-4500-ac9c-4682f59c8496"}], "security_groups": [{"name": "tempest-securitygroup--845305631"}], "key_name": "tempest-keypair-1026774852", "user_data": "}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:28.430887 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] validate_networks() for [('0419ddd4-ade8-4500-ac9c-4682f59c8496', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:14:28.792650 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:14:28.793079 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:14:28.793558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:14:28.794021 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:14:28.794463 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:14:28.803326 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:28.803777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:28.804612 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:28.805051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:28.821876 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:14:28.825793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:14:28.837543 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:14:28.839768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:14:28.992338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-668c1190-b8d3-4a7f-be9f-7f7ad99b8da7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667951 Jul 13 09:14:28.993084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 431/895] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:14:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:14:29.004152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2cb94872-fbb5-4f12-84f8-d1db4247760f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:29.004724 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2cb94872-fbb5-4f12-84f8-d1db4247760f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:29.077168 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2cb94872-fbb5-4f12-84f8-d1db4247760f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:29.090135 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2cb94872-fbb5-4f12-84f8-d1db4247760f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1241 microversion: 2.1 time: 0.090784 Jul 13 09:14:29.091192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 465/896] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:28 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:29.244822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:29.245440 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:29.251577 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:29.252136 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:29.253177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:29.253614 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:29.387250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:29.394370 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b0af65cb-5508-466c-94d5-7e743015bdf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.153332 Jul 13 09:14:29.394948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 432/897] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:29 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:30.106515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:30.107119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:30.114287 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:30.114732 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:30.115482 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:30.115912 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:30.177131 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:30.187935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-f5c66f6f-66d0-4d39-8f5a-7b714d82eb0d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1245 microversion: 2.1 time: 0.085241 Jul 13 09:14:30.188522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 466/898] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:30 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:30.411402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:30.411921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:30.418398 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:30.418844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:30.419598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:30.420050 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:30.553494 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:30.561154 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-807914ac-d4b9-4c74-a945-13a28f388482 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.153726 Jul 13 09:14:30.561722 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 433/899] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:30 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:31.204746 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:31.205992 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:31.208706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:31.213597 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:31.213978 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:31.214809 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:31.215238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:31.219508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:31.281593 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:31.287509 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4e936def-ac2a-49a4-9565-d8447020b228 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1293 microversion: 2.1 time: 0.086709 Jul 13 09:14:31.288080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 467/900] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:31 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:31.578870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:31.579479 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:31.586647 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:31.586814 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:31.587571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:31.588005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:31.608111 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:31.742268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:31.750599 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-573c4ba6-94d4-49f1-a846-ea8579728282 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.175572 Jul 13 09:14:31.751189 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 434/901] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:31 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:32.307279 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:32.307909 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:32.317405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:32.317405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:32.317405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:32.317405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:32.386483 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:32.394359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-deca29fa-83f5-40c0-a622-5dfe1b22c0cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1301 microversion: 2.1 time: 0.091697 Jul 13 09:14:32.394921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 468/902] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:32 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:32.773268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:32.775368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:32.779673 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:32.783465 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:32.785749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:32.785749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:32.785749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:32.954141 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:32.962238 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a85385d8-a6b0-4060-9e56-971711b92a8e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.198482 Jul 13 09:14:32.963557 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 435/903] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:32 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:33.413077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:33.413077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:33.425151 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:33.426533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:33.430132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:33.430927 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:33.582766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:33.595116 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-04ab16b5-0d2e-4820-be99-e0811aa35ee2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.186635 Jul 13 09:14:33.595541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 469/904] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:33 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:33.979298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:33.979904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:33.987052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:33.987495 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:33.989265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:33.990094 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:34.237475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:34.247087 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a6dea935-108f-45d5-9755-a47060623255 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.271520 Jul 13 09:14:34.252827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 436/905] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:33 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:34.518543 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-00408c90-a36e-468a-8bb0-894b9d0412d1 req-a433c866-db0d-410d-a4fa-031aa75a30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644fc77e-64b1-4f38-9832-4cf3f5acea52", "tag": "db1124e5-b271-4db3-a0cf-3616e2eb1844"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:34.533665 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-00408c90-a36e-468a-8bb0-894b9d0412d1 req-a433c866-db0d-410d-a4fa-031aa75a30d3 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:34.535443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-00408c90-a36e-468a-8bb0-894b9d0412d1 req-a433c866-db0d-410d-a4fa-031aa75a30d3 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:34.552589 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-00408c90-a36e-468a-8bb0-894b9d0412d1 req-a433c866-db0d-410d-a4fa-031aa75a30d3 service nova] Creating event network-changed:db1124e5-b271-4db3-a0cf-3616e2eb1844 for instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 on hv-cinder-84962 Jul 13 09:14:34.563209 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-00408c90-a36e-468a-8bb0-894b9d0412d1 req-a433c866-db0d-410d-a4fa-031aa75a30d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070441 Jul 13 09:14:34.569723 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 470/906] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:34.618321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:34.619418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:34.631135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:34.633006 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:34.633565 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:34.638391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:34.970444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:34.981254 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-85c3a2e3-5b2d-44ad-858c-6ded1f000997 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.370056 Jul 13 09:14:34.994442 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 437/907] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:34 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:35.270773 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:35.277070 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:35.278398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:35.278864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:35.279680 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:35.280119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:35.439218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:35.447649 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8f722dd4-e563-4049-84ae-5f7b3575f04c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1566 microversion: 2.1 time: 0.181080 Jul 13 09:14:35.448502 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 471/908] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:35 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:35.835462 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-393191558", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2103770607", "security_groups": [{"name": "tempest-secgroup-smoke-1950628113"}], "block_device_mapping_v2": [{"uuid": "f3159371-f6f6-4ac0-891b-f130c8066eb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b440154-a6c9-4139-b7ed-df54c627be50"}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:35.980942 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] validate_networks() for [('3b440154-a6c9-4139-b7ed-df54c627be50', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:14:36.004381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:36.005081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:36.011875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.012315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.013077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.013508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.151404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:36.159041 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c4535bbc-2b07-4841-af13-e916a1545b89 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.159122 Jul 13 09:14:36.160355 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 472/909] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:35 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:36.447588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:14:36.448074 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:14:36.448473 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:14:36.448876 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:14:36.449283 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:14:36.458445 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.458889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.459878 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.460271 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.465079 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:36.465859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:36.472300 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.472747 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.473771 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.474581 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.478139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for project 02051a1f629a48199bb1eb504c747294. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:14:36.482430 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Getting quotas for user 6f101dab08684c2483f67a9357efeae8 and project 02051a1f629a48199bb1eb504c747294. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:14:36.543173 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:14:36.545156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f3159371-f6f6-4ac0-891b-f130c8066eb9',volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:14:36.617743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:36.625527 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a8c7f4f1-c2c6-46d1-929b-757799bc698a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1567 microversion: 2.1 time: 0.164609 Jul 13 09:14:36.626741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 473/910] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:36 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:36.643550 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:36.644245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:36.650424 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.654539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.654539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:36.654539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:36.999616 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-be774b26-477a-4ebd-b6b8-d17b4e01d285 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "POST /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972/action" status: 202 len: 0 microversion: 2.1 time: 0.359584 Jul 13 09:14:37.000375 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 474/911] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 13 09:14:36 2022] POST /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:14:37.005253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-995bb0c0-5ced-43ee-8847-d71cb08f5916 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.173970 Jul 13 09:14:37.006782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 438/912] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:14:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:14:37.008851 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:37.009481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:37.016389 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:37.018742 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:37.018742 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:37.019035 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-719b892c-21bd-4c62-924f-342685c803ed tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:37.019192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:37.019325 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-719b892c-21bd-4c62-924f-342685c803ed tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:37.101764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-719b892c-21bd-4c62-924f-342685c803ed tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:37.109090 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-719b892c-21bd-4c62-924f-342685c803ed tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1094 microversion: 2.1 time: 0.096285 Jul 13 09:14:37.109657 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 439/913] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:37 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:37.177391 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:37.177518 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:37.179624 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:37.187592 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ee605931-3a80-42ad-a61b-63b156ad2c10 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1515 microversion: 2.1 time: 0.182823 Jul 13 09:14:37.188998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:37.189431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:37.190253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:37.190700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:37.199039 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 475/914] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:37 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:37.335486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:37.362022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fe77648e-ba6e-437f-917d-7b915afb4a7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.189710 Jul 13 09:14:37.362767 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 440/915] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:37 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:37.906838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-d5e93d35-0387-47bd-ab6d-3e5f44a90547 req-f1b576a3-5d13-407b-b1f0-8b103f5258b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "name": "network-vif-unplugged", "status": "completed", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:37.916266 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-d5e93d35-0387-47bd-ab6d-3e5f44a90547 req-f1b576a3-5d13-407b-b1f0-8b103f5258b9 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:37.916932 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-d5e93d35-0387-47bd-ab6d-3e5f44a90547 req-f1b576a3-5d13-407b-b1f0-8b103f5258b9 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:37.928657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.compute.server_external_events [req-d5e93d35-0387-47bd-ab6d-3e5f44a90547 req-f1b576a3-5d13-407b-b1f0-8b103f5258b9 service nova] Unable to find a host for instance d44bf150-cda8-482a-a0b9-f51d8070d972. Dropping event network-vif-unplugged {{(pid=118252) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 13 09:14:37.929630 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-d5e93d35-0387-47bd-ab6d-3e5f44a90547 req-f1b576a3-5d13-407b-b1f0-8b103f5258b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027117 Jul 13 09:14:37.930322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 476/916] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 13 09:14:38.126329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:38.127572 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:38.135485 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:38.135929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:38.136700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:38.137170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:38.208669 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:38.209390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:38.212403 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:38.219979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:38.219979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:38.219979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:38.219979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:38.221740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8af61848-be9f-4106-bd78-2e0288978bde tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1144 microversion: 2.1 time: 0.099421 Jul 13 09:14:38.222388 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 441/917] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:38 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:38.382803 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:38.383483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:38.391461 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:38.391911 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:38.392732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:38.393435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:38.459400 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:38.468541 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0979eb1b-6af9-4b7b-859e-bba2e06e3369 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1515 microversion: 2.1 time: 0.265523 Jul 13 09:14:38.469129 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 477/918] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:38 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:38.558973 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:38.566917 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7061ff47-e045-4cb8-bb10-8a13e17a8744 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.190944 Jul 13 09:14:38.567468 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 442/919] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:38 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:39.242368 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:39.243782 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:39.252960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:39.252960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:39.252960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:39.254856 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:39.255741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:39.365315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:39.383320 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7dd0224e-feb0-43c1-92e6-75c71e6d2064 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1200 microversion: 2.1 time: 0.147188 Jul 13 09:14:39.383908 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 478/920] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:39 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1200 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:39.489105 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:39.489750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:39.496316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:39.496768 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:39.497536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:39.497999 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:39.584329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:39.584934 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:39.594556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:39.595346 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:39.596571 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:39.597864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:39.766955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:39.776976 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8f76ffa3-12aa-4a55-bdec-f29b1da9017c tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1517 microversion: 2.1 time: 0.291704 Jul 13 09:14:39.780024 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 443/921] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:39 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1517 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:39.803341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:39.810941 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-81284cb1-bcc0-4466-a721-35f65607bc55 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.230901 Jul 13 09:14:39.811515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 479/922] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:39 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:40.068823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-c5bd08a6-9016-4486-a9f2-de94963cd223 req-8e404077-5cf4-4e22-ab1e-56aa387b1229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644fc77e-64b1-4f38-9832-4cf3f5acea52", "name": "network-vif-plugged", "status": "completed", "tag": "db1124e5-b271-4db3-a0cf-3616e2eb1844"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:40.077528 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-c5bd08a6-9016-4486-a9f2-de94963cd223 req-8e404077-5cf4-4e22-ab1e-56aa387b1229 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.078282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-c5bd08a6-9016-4486-a9f2-de94963cd223 req-8e404077-5cf4-4e22-ab1e-56aa387b1229 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:40.090308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-c5bd08a6-9016-4486-a9f2-de94963cd223 req-8e404077-5cf4-4e22-ab1e-56aa387b1229 service nova] Creating event network-vif-plugged:db1124e5-b271-4db3-a0cf-3616e2eb1844 for instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 on hv-cinder-84962 Jul 13 09:14:40.095986 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-c5bd08a6-9016-4486-a9f2-de94963cd223 req-8e404077-5cf4-4e22-ab1e-56aa387b1229 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031830 Jul 13 09:14:40.096546 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 444/923] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:40.401050 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:40.404158 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:40.414686 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.416339 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:40.416339 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.416775 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:40.587142 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:40.595791 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1b9d4e91-12b9-406f-b77d-97a05a83d506 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1278 microversion: 2.1 time: 0.198590 Jul 13 09:14:40.596391 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 480/924] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:40 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:40.797170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:40.798368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:40.813420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.814816 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:40.818144 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.818870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:40.828191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:40.829386 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:40.843322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.847864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:40.847864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:40.847864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:41.000748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:41.009192 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b9ea19f6-7a36-4d26-996e-66eb4d4dd7d7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1366 microversion: 2.1 time: 0.185341 Jul 13 09:14:41.009878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 481/925] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:40 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:41.019630 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:41.040452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3ec5f006-499f-4e47-b6a1-9e4da073d5a3 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.247973 Jul 13 09:14:41.051535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 445/926] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:40 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:41.444611 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-45b84588-6339-48e6-b3e4-0e7948c57e7a req-8fee4553-b5c9-4e33-823d-88341c8f3751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be6baa8-3d1d-4b03-ab21-b073f6f00dbc", "tag": "f6698d68-a4ae-4ad4-97a7-c02b13a8888c"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:41.453628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-45b84588-6339-48e6-b3e4-0e7948c57e7a req-8fee4553-b5c9-4e33-823d-88341c8f3751 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:41.454096 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-45b84588-6339-48e6-b3e4-0e7948c57e7a req-8fee4553-b5c9-4e33-823d-88341c8f3751 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:41.465762 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-45b84588-6339-48e6-b3e4-0e7948c57e7a req-8fee4553-b5c9-4e33-823d-88341c8f3751 service nova] Creating event network-changed:f6698d68-a4ae-4ad4-97a7-c02b13a8888c for instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc on hv-cinder-84962 Jul 13 09:14:41.474414 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-45b84588-6339-48e6-b3e4-0e7948c57e7a req-8fee4553-b5c9-4e33-823d-88341c8f3751 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Jul 13 09:14:41.477219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 482/927] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:41.614931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:41.619584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:41.626935 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:41.627443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:41.629740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:41.630308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:41.887648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:41.895765 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a3f671dc-3971-4bfb-914e-9296afef4cc8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.286490 Jul 13 09:14:41.896336 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 446/928] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:41 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:42.037221 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:42.037844 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:42.044147 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.044594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.045354 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.045789 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.057153 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:42.057757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:42.063716 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.064162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.064916 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.065346 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.183072 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:42.193203 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ee530415-d22b-43d8-b444-1631082195fc tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1554 microversion: 2.1 time: 0.160197 Jul 13 09:14:42.193864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 483/929] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:42 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:42.220015 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:42.225110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:42.232127 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.232576 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.237269 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.237269 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.316635 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-689fd6fa-d280-4265-8792-913f11ed9c81 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104332 Jul 13 09:14:42.317341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 484/930] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:14:42 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:42.375225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:42.384334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-06ec45b4-6e06-4a48-9c7b-1bf67d7f72d6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.330963 Jul 13 09:14:42.385442 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 447/931] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:42 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:42.916622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:42.917915 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:42.924409 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.924865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.926711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:42.927158 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:42.930269 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:43.389804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:43.400401 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e3d51346-22fb-4a3b-b1ea-4fa4458a92f2 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.487970 Jul 13 09:14:43.402579 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 485/932] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:42 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:43.402844 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:43.403593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:43.410581 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:43.411254 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:43.412267 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:43.412864 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:43.583590 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:43.591294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9be26036-3655-4c1a-a23e-776b84da5818 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.192583 Jul 13 09:14:43.591865 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 448/933] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:43 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:43.682160 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-f21996a6-9c6f-4c00-8a39-4e3544580105 req-f0bf6af8-a54c-47a6-b484-e16cd9b2e0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644fc77e-64b1-4f38-9832-4cf3f5acea52", "tag": "db1124e5-b271-4db3-a0cf-3616e2eb1844"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:43.690002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-f21996a6-9c6f-4c00-8a39-4e3544580105 req-f0bf6af8-a54c-47a6-b484-e16cd9b2e0e8 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:43.690470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-f21996a6-9c6f-4c00-8a39-4e3544580105 req-f0bf6af8-a54c-47a6-b484-e16cd9b2e0e8 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:43.703141 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-f21996a6-9c6f-4c00-8a39-4e3544580105 req-f0bf6af8-a54c-47a6-b484-e16cd9b2e0e8 service nova] Creating event network-changed:db1124e5-b271-4db3-a0cf-3616e2eb1844 for instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 on hv-cinder-84962 Jul 13 09:14:43.714886 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-f21996a6-9c6f-4c00-8a39-4e3544580105 req-f0bf6af8-a54c-47a6-b484-e16cd9b2e0e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031360 Jul 13 09:14:43.714886 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 486/934] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:44.418542 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:44.419155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:44.426400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:44.427126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:44.428095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:44.428713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:44.610675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:44.612105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:44.618105 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:44.619327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:44.620036 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:44.621036 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:44.621642 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:44.632212 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9cfec0ca-1898-4e1d-9397-36d890be1ad9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.216247 Jul 13 09:14:44.633648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 449/935] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:44 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:44.805402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:44.816838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-95b27b99-b481-4cac-8edf-d42412204605 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.210316 Jul 13 09:14:44.828764 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 487/936] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:44 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:45.648656 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:45.649381 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:45.656052 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:45.656503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:45.657268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:45.657709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:45.799282 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:45.806901 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3a314803-5c6c-45cc-bf1b-bf0ed8193dd0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.162074 Jul 13 09:14:45.807556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 450/937] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:45 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:45.835496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:45.836147 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:45.842696 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:45.843149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:45.843916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:45.844355 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:46.011481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:46.018993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-99b8f0b6-e549-4dce-ae73-2dd16ec5097e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.187980 Jul 13 09:14:46.019564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 488/938] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:45 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:46.823614 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:46.824225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:46.826222 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=4 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:46.831518 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:46.831957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:46.832718 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:46.833665 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:46.968233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:46.976480 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f6b264ea-4c31-4783-b9f3-95566e749815 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.156642 Jul 13 09:14:46.977193 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 451/939] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:46 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:47.037762 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:47.038411 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:47.044860 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:47.045309 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:47.046114 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:47.046552 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:47.179080 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:47.186563 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-60ebb629-a063-4686-991f-5ddfd0e441ee tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.153641 Jul 13 09:14:47.187130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 489/940] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:47 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:47.993250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:47.993896 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:47.995975 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=14 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:48.001264 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:48.001714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:48.002521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:48.002966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:48.143770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:48.151636 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-750245f5-50a8-42ff-87d1-d6d6765a6019 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.162914 Jul 13 09:14:48.152596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 452/941] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:47 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:48.203497 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:48.204284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:48.211788 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:48.212244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:48.213042 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:48.213476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:48.359422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:48.362380 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bbcf242b-fdb8-4e32-93f8-57cd73c515c6 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.162640 Jul 13 09:14:48.363119 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 490/942] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:48 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:49.168584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:49.169301 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:49.175553 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:49.175998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:49.176751 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:49.177183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:49.197137 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=100 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:14:49.313660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:49.322005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cbba9c2f-be7f-49b8-935b-f299dc3268a3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.157332 Jul 13 09:14:49.322624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 453/943] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:49 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:49.379670 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:49.380284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:49.387137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:49.387588 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:49.388342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:49.388783 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:49.532278 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:49.540939 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7a5b74cf-c471-4f33-ab54-be18568c02b1 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.164987 Jul 13 09:14:49.543440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 491/944] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:49 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:50.340767 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:50.341687 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:50.360817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:50.361269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:50.362253 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:50.362846 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:50.510995 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:50.518686 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5daf3aff-c155-404b-a8e7-9f85fa673cf8 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.183103 Jul 13 09:14:50.519450 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 454/945] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:50 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:50.558829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:50.559440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:50.565845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:50.566329 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:50.567090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:50.567523 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:50.702214 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:50.709857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8bb9a499-5483-4838-a916-5ed6f749b36a tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.154950 Jul 13 09:14:50.710461 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 492/946] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:50 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:51.535737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:51.536406 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:51.543834 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:51.544290 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:51.545065 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:51.545512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:51.681205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:51.688817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-118ad3d0-a1ff-4c00-991f-00ea3caff3b0 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.157025 Jul 13 09:14:51.689571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 455/947] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:51 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:51.727250 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:51.728049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:51.735383 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:51.735717 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:51.736583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:51.737146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:51.887876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:51.895994 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d9214c42-9dc0-45fe-8721-c3c4d2b4da7b tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.172727 Jul 13 09:14:51.896583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 493/948] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:51 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:52.166250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-447dddd1-6714-41da-b204-3de2d448ebf0 req-cc769e2e-23cb-4a58-b842-e38b847209d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be6baa8-3d1d-4b03-ab21-b073f6f00dbc", "name": "network-vif-plugged", "status": "completed", "tag": "f6698d68-a4ae-4ad4-97a7-c02b13a8888c"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:52.174765 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-447dddd1-6714-41da-b204-3de2d448ebf0 req-cc769e2e-23cb-4a58-b842-e38b847209d4 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:52.175963 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-447dddd1-6714-41da-b204-3de2d448ebf0 req-cc769e2e-23cb-4a58-b842-e38b847209d4 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:52.186346 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-447dddd1-6714-41da-b204-3de2d448ebf0 req-cc769e2e-23cb-4a58-b842-e38b847209d4 service nova] Creating event network-vif-plugged:f6698d68-a4ae-4ad4-97a7-c02b13a8888c for instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc on hv-cinder-84962 Jul 13 09:14:52.191722 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-447dddd1-6714-41da-b204-3de2d448ebf0 req-cc769e2e-23cb-4a58-b842-e38b847209d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030582 Jul 13 09:14:52.192432 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 456/949] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:14:52.705689 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:52.706332 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:52.712554 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:52.712994 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:52.713792 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:52.714414 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:52.858180 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:52.865852 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e2f93b96-4b74-4978-aa85-918ae5c5f7ca tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.163868 Jul 13 09:14:52.866460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 494/950] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:52 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:52.913436 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:52.914162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:52.920880 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:52.921329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:52.922120 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:52.922556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:53.058817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:53.067400 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ea0453f6-b4b3-480a-974f-0fdf2a7a7d75 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.158016 Jul 13 09:14:53.068468 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 457/951] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:52 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:53.883938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:53.884554 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:53.891081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:53.891534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:53.892294 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:53.892728 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:54.033636 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:54.041566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3de93567-504e-4b5e-9a58-136753936ac7 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1266 microversion: 2.1 time: 0.162260 Jul 13 09:14:54.042278 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 495/952] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:53 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:54.084568 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:54.085188 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:54.095038 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:54.097416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:54.098883 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:54.099338 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:54.206615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-ca05bc4f-7ea1-49a0-9f13-60ba1057663f req-3b937da7-924d-43e4-a4a8-ea449c0951cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "name": "network-vif-plugged", "status": "completed", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:54.215196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-ca05bc4f-7ea1-49a0-9f13-60ba1057663f req-3b937da7-924d-43e4-a4a8-ea449c0951cd service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:54.215632 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-ca05bc4f-7ea1-49a0-9f13-60ba1057663f req-3b937da7-924d-43e4-a4a8-ea449c0951cd service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:54.226885 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-ca05bc4f-7ea1-49a0-9f13-60ba1057663f req-3b937da7-924d-43e4-a4a8-ea449c0951cd service nova] Creating event network-vif-plugged:c98f0a70-76c7-4798-9dfc-6e8275493f88 for instance d44bf150-cda8-482a-a0b9-f51d8070d972 on hv-cinder-84962 Jul 13 09:14:54.232211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-ca05bc4f-7ea1-49a0-9f13-60ba1057663f req-3b937da7-924d-43e4-a4a8-ea449c0951cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029267 Jul 13 09:14:54.232821 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 496/953] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:14:54.241647 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:54.250860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-899ee12f-859e-46cc-b459-e28b75dcefe2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.170072 Jul 13 09:14:54.252002 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 458/954] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:54 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:55.060538 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:55.061233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:55.067409 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:55.067847 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:55.068608 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:55.069035 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:55.207607 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:55.215876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0ab11a14-78d8-4cc7-bf05-b3e6de3e3028 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1452 microversion: 2.1 time: 0.160707 Jul 13 09:14:55.216449 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 497/955] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:55 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:55.233008 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:55.233750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:55.240377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:55.240823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:55.241589 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:55.242047 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:55.269381 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:55.269896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:55.276667 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:55.281574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:55.281574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:55.281574 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:55.400185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:55.407762 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-852aa438-6722-45a4-9837-ea8fa7dceb93 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1452 microversion: 2.1 time: 0.178650 Jul 13 09:14:55.408344 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 459/956] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:55 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:55.418370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:55.426304 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-39b57305-dfab-42fd-85e9-d0e7faad1580 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1573 microversion: 2.1 time: 0.161249 Jul 13 09:14:55.427323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 498/957] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:55 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:14:56.444146 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:14:56.444782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:14:56.451560 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:56.451993 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:56.452777 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:56.453196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:56.588564 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:14:56.597684 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1e2f9c5f-a36c-49b0-87c2-8ac2fcc54b97 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1560 microversion: 2.1 time: 0.157350 Jul 13 09:14:56.599927 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 460/958] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:14:56 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:14:57.697617 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-602550b8-27d2-4ef7-9587-7649f2c4dfa7 req-a62cb397-7a0f-4e17-8ef4-f3458edc561e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be6baa8-3d1d-4b03-ab21-b073f6f00dbc", "tag": "f6698d68-a4ae-4ad4-97a7-c02b13a8888c"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:14:57.710333 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-602550b8-27d2-4ef7-9587-7649f2c4dfa7 req-a62cb397-7a0f-4e17-8ef4-f3458edc561e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:14:57.711100 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-602550b8-27d2-4ef7-9587-7649f2c4dfa7 req-a62cb397-7a0f-4e17-8ef4-f3458edc561e service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:14:57.725395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-602550b8-27d2-4ef7-9587-7649f2c4dfa7 req-a62cb397-7a0f-4e17-8ef4-f3458edc561e service nova] Creating event network-changed:f6698d68-a4ae-4ad4-97a7-c02b13a8888c for instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc on hv-cinder-84962 Jul 13 09:14:57.730895 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-602550b8-27d2-4ef7-9587-7649f2c4dfa7 req-a62cb397-7a0f-4e17-8ef4-f3458edc561e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039651 Jul 13 09:14:57.731567 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 499/959] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:29.502890 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:29.503453 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:29.506084 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:29.506795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=40 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:29.511462 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:29.516476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:29.516476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:29.516476 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:29.536422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-42167d8f-b701-4826-b8fe-1e9a167ed2ee tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/ips" status: 200 len: 148 microversion: 2.1 time: 0.037399 Jul 13 09:15:29.537022 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 461/960] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:15:29 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:29.545373 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=67 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:29.550846 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=77 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:29.551182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0b68cac-7b93-4ca8-9434-a85ed51249f4"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:29.552361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:29.558370 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:29.558819 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:29.559581 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:29.560013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:29.637734 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Invalid volume: volume b0b68cac-7b93-4ca8-9434-a85ed51249f4 is already attached to instances: ec2037c6-2367-4a79-8c54-1455e09e6280 Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: POST /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/os-volume_attachments HTTP/1.1 Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 74 Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:15:29.639547 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {"volumeAttachment": {"volumeId": "b0b68cac-7b93-4ca8-9434-a85ed51249f4"}} Jul 13 09:15:29.641743 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Invalid volume: volume b0b68cac-7b93-4ca8-9434-a85ed51249f4 is already attached to instances: ec2037c6-2367-4a79-8c54-1455e09e6280 Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'server_id': '644fc77e-64b1-4f38-9832-4cf3f5acea52', 'body': {'volumeAttachment': {'volumeId': 'b0b68cac-7b93-4ca8-9434-a85ed51249f4'}}} Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0b68cac-7b93-4ca8-9434-a85ed51249f4 is already attached to instances: ec2037c6-2367-4a79-8c54-1455e09e6280 Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:29.642725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0b68cac-7b93-4ca8-9434-a85ed51249f4 is already attached to instances: ec2037c6-2367-4a79-8c54-1455e09e6280 Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:29.644215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0b68cac-7b93-4ca8-9434-a85ed51249f4 is already attached to instances: ec2037c6-2367-4a79-8c54-1455e09e6280 Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 400 to user: Invalid volume: volume b0b68cac-7b93-4ca8-9434-a85ed51249f4 is already attached to instances: ec2037c6-2367-4a79-8c54-1455e09e6280 {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b7ca0a4d-a621-4c31-887a-89182b2bd5b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097849 Jul 13 09:15:29.645646 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 500/961] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:15:29 2022] POST /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:15:29.651120 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:29.651847 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:29.659753 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:29.668695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:29.668695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:29.668695 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:29.685746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:15:30.008040 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c0db5cd1-925b-4cc1-80fd-6729c3658be7 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 204 len: 0 microversion: 2.1 time: 0.360331 Jul 13 09:15:30.008661 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 462/962] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:15:29 2022] DELETE /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:15:30.018194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:30.018804 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:30.026166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:30.026615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:30.027395 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:30.027864 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:30.385315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:30.392937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-edd38f91-face-4d71-b85e-fee300123c64 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1679 microversion: 2.1 time: 0.380085 Jul 13 09:15:30.393551 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 501/963] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:30 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1679 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:31.411451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:31.412063 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:31.418872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:31.419316 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:31.420077 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:31.420509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:31.641372 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:31.650374 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f8a7b774-ed74-456d-9c3a-1bb5a1a799d0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1679 microversion: 2.1 time: 0.243749 Jul 13 09:15:31.651021 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 463/964] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:31 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:32.448317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-1a3409bc-a77d-465d-a8f3-643267f3251d req-97feb6b4-9e03-4624-9edf-8494cb526f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644fc77e-64b1-4f38-9832-4cf3f5acea52", "name": "network-vif-deleted", "tag": "db1124e5-b271-4db3-a0cf-3616e2eb1844"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:32.457837 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-1a3409bc-a77d-465d-a8f3-643267f3251d req-97feb6b4-9e03-4624-9edf-8494cb526f52 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:32.458315 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-1a3409bc-a77d-465d-a8f3-643267f3251d req-97feb6b4-9e03-4624-9edf-8494cb526f52 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:32.469878 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-1a3409bc-a77d-465d-a8f3-643267f3251d req-97feb6b4-9e03-4624-9edf-8494cb526f52 service nova] Creating event network-vif-deleted:db1124e5-b271-4db3-a0cf-3616e2eb1844 for instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 on hv-cinder-84962 Jul 13 09:15:32.475031 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-1a3409bc-a77d-465d-a8f3-643267f3251d req-97feb6b4-9e03-4624-9edf-8494cb526f52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Jul 13 09:15:32.480211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 502/965] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:32.667866 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:32.668684 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:32.675440 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:32.678092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:32.678092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:32.678092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:32.742757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:32.752544 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-92ebb13f-b9e7-4e9a-97de-14f16eb75703 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 200 len: 1326 microversion: 2.1 time: 0.086588 Jul 13 09:15:32.752544 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 464/966] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:32 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:33.768620 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:33.771671 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:33.775450 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:33.775896 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:33.776645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:33.777076 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:33.790529 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 HTTP/1.1 Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:15:33.792077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:15:33.793694 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '644fc77e-64b1-4f38-9832-4cf3f5acea52'} Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:15:33.794748 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:15:33.796321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:15:33.800495 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:15:33.800495 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7952d8e7-8f5d-4762-9e1d-b7857ee4caae tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 404 len: 111 microversion: 2.1 time: 0.029650 Jul 13 09:15:33.800495 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 503/967] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:33 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:15:33.807098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4e3a34f8-6780-4d3a-85ac-b2123b795755 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '.version_select at 0x7fad221c0c10>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:33.871295 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4e3a34f8-6780-4d3a-85ac-b2123b795755 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026774852" status: 202 len: 0 microversion: 2.1 time: 0.067958 Jul 13 09:15:33.871937 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 465/968] 10.222.0.40 () {58 vars in 1220 bytes} [Wed Jul 13 09:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026774852 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:15:34.714612 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:34.715202 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:34.721517 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:34.722115 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:34.722876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:34.723302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:34.813344 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lazy-loading 'services' on Instance uuid ec2037c6-2367-4a79-8c54-1455e09e6280 {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:15:35.023993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4898c3b7-4022-4846-803e-287a919c7b7d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments/b0b68cac-7b93-4ca8-9434-a85ed51249f4" status: 202 len: 0 microversion: 2.1 time: 0.313411 Jul 13 09:15:35.024693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 504/969] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:15:34 2022] DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments/b0b68cac-7b93-4ca8-9434-a85ed51249f4 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:15:35.034312 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:35.035225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:35.042112 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:35.042593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:35.043353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:35.043810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:35.073451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9077f4f4-2480-4798-949a-dd036da3015d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Jul 13 09:15:35.074004 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 466/970] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:15:35 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:36.086421 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:36.087426 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:36.093556 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:36.094002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:36.094822 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:36.095256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:36.122875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8e5ceaa7-7cc3-4bb3-994b-282619964bf3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041218 Jul 13 09:15:36.123424 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 505/971] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:15:36 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:15:36.182921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:36.183433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:36.191314 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:36.191770 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:36.192561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:36.193005 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:36.220369 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:15:36.462784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4654d71b-25b3-4378-98db-d37b4d4113a6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 204 len: 0 microversion: 2.1 time: 0.283363 Jul 13 09:15:36.463377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 467/972] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:15:36 2022] DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:15:36.472651 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:36.473245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:36.479364 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:36.479814 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:36.480573 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:36.481007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:36.615892 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:36.623326 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b8236520-4f89-4589-be63-33f78b31c3ce tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1678 microversion: 2.1 time: 0.155771 Jul 13 09:15:36.623918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 506/973] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:36 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:37.641122 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:37.641976 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:37.648471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:37.648911 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:37.649682 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:37.650147 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:37.779185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:37.787309 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a32f784b-1a5e-449c-ada4-43d848f72ab9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1678 microversion: 2.1 time: 0.150396 Jul 13 09:15:37.787874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 468/974] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:37 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:38.805339 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:38.805950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:38.812408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:38.812845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:38.814290 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:38.814813 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:38.878584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:38.886626 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-212efeb3-e3dd-4a55-a3c8-b142d78f75c8 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1611 microversion: 2.1 time: 0.085181 Jul 13 09:15:38.888091 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 507/975] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:38 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1611 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:39.131326 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-473be40b-6952-4589-adcd-e67fdf6b9a20 req-a6c1bb6a-de24-4f1f-aab7-8aec28fcec66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2037c6-2367-4a79-8c54-1455e09e6280", "name": "network-vif-deleted", "tag": "05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:39.138576 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-473be40b-6952-4589-adcd-e67fdf6b9a20 req-a6c1bb6a-de24-4f1f-aab7-8aec28fcec66 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:39.139023 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-473be40b-6952-4589-adcd-e67fdf6b9a20 req-a6c1bb6a-de24-4f1f-aab7-8aec28fcec66 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:39.150250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-473be40b-6952-4589-adcd-e67fdf6b9a20 req-a6c1bb6a-de24-4f1f-aab7-8aec28fcec66 service nova] Creating event network-vif-deleted:05d50ea9-a5d7-4bad-81c0-db7a5e8b7bb7 for instance ec2037c6-2367-4a79-8c54-1455e09e6280 on hv-cinder-84962 Jul 13 09:15:39.155138 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-473be40b-6952-4589-adcd-e67fdf6b9a20 req-a6c1bb6a-de24-4f1f-aab7-8aec28fcec66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029782 Jul 13 09:15:39.156104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 469/976] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:39.904341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:39.905106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:39.911594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:39.912155 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:39.913076 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:39.913582 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:39.946408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:39.946865 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:39.947390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lazy-loading 'fault' on Instance uuid ec2037c6-2367-4a79-8c54-1455e09e6280 {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:15:39.990256 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:39.998493 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-05d37688-ad59-4e78-b6af-fea6dd3bf5c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 200 len: 1330 microversion: 2.1 time: 0.098165 Jul 13 09:15:39.999078 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 508/977] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:39 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:41.020126 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:41.020823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:41.027078 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:41.027571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:41.028339 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:41.028776 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:41.042714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 HTTP/1.1 Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:15:41.044353 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:15:41.045930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'ec2037c6-2367-4a79-8c54-1455e09e6280'} Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:15:41.046819 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:15:41.048472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:15:41.049758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:15:41.049758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-3b5906a4-6616-4b2f-9428-18a901196cfe tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 404 len: 111 microversion: 2.1 time: 0.031683 Jul 13 09:15:41.049758 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 470/978] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:41 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:15:41.054675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-881fcf64-9ea3-468e-8d2f-4ad9ba6c5d4e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '.version_select at 0x7fad261abf70>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:41.122166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-881fcf64-9ea3-468e-8d2f-4ad9ba6c5d4e tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130226329" status: 202 len: 0 microversion: 2.1 time: 0.071134 Jul 13 09:15:41.122737 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 509/979] 10.222.0.40 () {58 vars in 1217 bytes} [Wed Jul 13 09:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130226329 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:15:41.897187 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-5c5b6f48-9d8c-4cb1-8d08-ba9dc8bc8fc6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: .version_select at 0x7fad21744550>, body: {"keypair": {"name": "tempest-keypair-1260684561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+hlNWRkVVdLHVGzgZNQGuwl1+EYUapjHO9jRWqDimD69loHbVJMsF2wjuDL6tBi8IIV8kbVstX7OiaaPqO6ehdN++09LapwcdZwXI6QrPbvPkU8xr5ln85GHl7uHpnUw=="}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:41.910881 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-5c5b6f48-9d8c-4cb1-8d08-ba9dc8bc8fc6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:15:41.914690 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-5c5b6f48-9d8c-4cb1-8d08-ba9dc8bc8fc6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:15:41.991417 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-5c5b6f48-9d8c-4cb1-8d08-ba9dc8bc8fc6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098130 Jul 13 09:15:41.992015 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 471/980] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:15:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:44.124496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1325016936", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0419ddd4-ade8-4500-ac9c-4682f59c8496"}], "security_groups": [{"name": "tempest-securitygroup--1839421821"}], "key_name": "tempest-keypair-1260684561", "user_data": "}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:44.229001 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] validate_networks() for [('0419ddd4-ade8-4500-ac9c-4682f59c8496', None, None, None, None, None)] {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:15:44.587047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:15:44.587470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:15:44.587944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:15:44.588351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:15:44.588766 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:15:44.597516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:44.597965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:44.598790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:44.599228 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:44.615841 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:15:44.619689 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:15:44.631146 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:15:44.633351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:15:44.745435 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-44cecf4e-f378-4058-be6e-d6381327dfe5 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625722 Jul 13 09:15:44.746110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 510/981] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:15:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:15:44.761637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f428cf6e-cdc4-4a23-85fb-25ad21876fec tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:44.762285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f428cf6e-cdc4-4a23-85fb-25ad21876fec tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:44.823156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f428cf6e-cdc4-4a23-85fb-25ad21876fec tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:44.830274 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f428cf6e-cdc4-4a23-85fb-25ad21876fec tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1242 microversion: 2.1 time: 0.072951 Jul 13 09:15:44.830843 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 472/982] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:44 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:45.847871 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:45.848497 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:45.856832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:45.857295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:45.858097 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:45.858549 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:45.922415 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:45.930815 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bb052eb9-7ce4-4fe1-9f8d-43a1dd6744e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1238 microversion: 2.1 time: 0.087814 Jul 13 09:15:45.931385 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 511/983] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:45 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:46.948250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:46.949095 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:46.955810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:46.957898 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:46.957898 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:46.957898 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:47.034548 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:47.041859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f3d44e86-f4a2-4fb4-89ce-e98f9aba7d31 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1300 microversion: 2.1 time: 0.097519 Jul 13 09:15:47.042452 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 473/984] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:46 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:48.058809 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:48.059880 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:48.066244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:48.066640 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:48.067419 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:48.067861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:48.102615 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-05110289-dada-4ead-aceb-3ce01d543ec3 req-138c35cd-28da-4a6b-9988-47d159889f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55aaee95-23bf-4d74-89b5-e798ff54172d", "tag": "e1329148-9041-40a5-847f-95e9f69b4fc6"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:48.118931 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-05110289-dada-4ead-aceb-3ce01d543ec3 req-138c35cd-28da-4a6b-9988-47d159889f88 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:48.119392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-05110289-dada-4ead-aceb-3ce01d543ec3 req-138c35cd-28da-4a6b-9988-47d159889f88 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:48.132409 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-05110289-dada-4ead-aceb-3ce01d543ec3 req-138c35cd-28da-4a6b-9988-47d159889f88 service nova] Creating event network-changed:e1329148-9041-40a5-847f-95e9f69b4fc6 for instance 55aaee95-23bf-4d74-89b5-e798ff54172d on hv-cinder-84962 Jul 13 09:15:48.137801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-05110289-dada-4ead-aceb-3ce01d543ec3 req-138c35cd-28da-4a6b-9988-47d159889f88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039500 Jul 13 09:15:48.138499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 474/985] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:48.219522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:48.228701 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3a5dc2c5-2255-442f-a538-e1469f5bfe14 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.173742 Jul 13 09:15:48.229873 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 512/986] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:48 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:49.247841 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:49.248535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:49.255791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:49.256238 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:49.256999 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:49.257435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:49.389592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:49.397138 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-18284663-8715-4067-bd6d-9dae007fa484 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.153944 Jul 13 09:15:49.397713 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 475/987] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:49 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:50.414732 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:50.415387 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:50.421847 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:50.422327 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:50.423094 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:50.423570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:50.554053 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:50.561492 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-60c27703-aba0-411c-b21a-8198e09956d9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.150633 Jul 13 09:15:50.562105 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 513/988] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:50 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:51.579368 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:51.580772 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:51.587150 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:51.587596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:51.588352 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:51.588795 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:51.717700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:51.725161 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-357255e7-499b-436f-b4ba-77789fbd89c4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.149762 Jul 13 09:15:51.725727 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 476/989] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:51 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:52.742876 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:52.743481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:52.749950 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:52.750425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:52.751181 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:52.752099 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:52.881296 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:52.888741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7a1132e4-b05e-49cc-b569-9645e8869e1c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.149751 Jul 13 09:15:52.889297 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 514/990] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:52 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:53.905716 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:53.906834 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:53.913958 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:53.914435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:53.915233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:53.915667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:54.043388 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:54.050889 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cc77d005-c3c7-4d0c-b22e-891155cff062 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.149020 Jul 13 09:15:54.051460 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 477/991] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:53 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:54.242912 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-50a00523-4e56-4a5f-9e0f-1378aa2cf38f req-07719e3f-2658-459b-bfc7-cf1775ad537b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aaee95-23bf-4d74-89b5-e798ff54172d", "name": "network-vif-plugged", "status": "completed", "tag": "e1329148-9041-40a5-847f-95e9f69b4fc6"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:54.252130 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-50a00523-4e56-4a5f-9e0f-1378aa2cf38f req-07719e3f-2658-459b-bfc7-cf1775ad537b service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:54.252577 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-50a00523-4e56-4a5f-9e0f-1378aa2cf38f req-07719e3f-2658-459b-bfc7-cf1775ad537b service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:54.263857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-50a00523-4e56-4a5f-9e0f-1378aa2cf38f req-07719e3f-2658-459b-bfc7-cf1775ad537b service nova] Creating event network-vif-plugged:e1329148-9041-40a5-847f-95e9f69b4fc6 for instance 55aaee95-23bf-4d74-89b5-e798ff54172d on hv-cinder-84962 Jul 13 09:15:54.269491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-50a00523-4e56-4a5f-9e0f-1378aa2cf38f req-07719e3f-2658-459b-bfc7-cf1775ad537b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030297 Jul 13 09:15:54.270100 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 515/992] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:55.067920 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:55.068529 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:55.070520 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:55.075757 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:55.076201 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:55.076987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:55.077435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:55.206235 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:55.213830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0cf3d87c-28d6-475e-b137-fce00f168863 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1368 microversion: 2.1 time: 0.150147 Jul 13 09:15:55.214429 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 478/993] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:55 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:56.228124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:56.228888 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:56.233483 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:56.234244 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:56.241140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:56.241591 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:56.242386 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:56.242827 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:56.374124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:15:56.382229 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-a2da90e4-d7ea-475a-80fe-327e2d9da7c9 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1556 microversion: 2.1 time: 0.155027 Jul 13 09:15:56.382795 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 516/994] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:15:56 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:15:56.398255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:15:56.398747 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:15:56.405148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:56.405596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:56.406388 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:56.406830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:56.423512 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:15:56.486262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-de8575d3-b4af-4193-b71c-8e0e66f7eca2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091921 Jul 13 09:15:56.489196 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 479/995] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:15:56 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:15:57.441877 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-160ec641-be33-4378-be21-242c8c825e04 req-5f97251c-cc51-4d7e-99c5-b68858689741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55aaee95-23bf-4d74-89b5-e798ff54172d", "tag": "e1329148-9041-40a5-847f-95e9f69b4fc6"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:15:57.450285 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-160ec641-be33-4378-be21-242c8c825e04 req-5f97251c-cc51-4d7e-99c5-b68858689741 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:15:57.450730 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-160ec641-be33-4378-be21-242c8c825e04 req-5f97251c-cc51-4d7e-99c5-b68858689741 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:15:57.461607 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-160ec641-be33-4378-be21-242c8c825e04 req-5f97251c-cc51-4d7e-99c5-b68858689741 service nova] Creating event network-changed:e1329148-9041-40a5-847f-95e9f69b4fc6 for instance 55aaee95-23bf-4d74-89b5-e798ff54172d on hv-cinder-84962 Jul 13 09:15:57.466663 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-160ec641-be33-4378-be21-242c8c825e04 req-5f97251c-cc51-4d7e-99c5-b68858689741 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029148 Jul 13 09:15:57.475260 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 517/996] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:19.213444 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:19.216838 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-f5cb6809-cdb7-4fa7-8fff-1443e50e4148 req-91c7af5c-2e78-4305-9397-d5f80b563eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:19.219654 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:19.220553 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:19.225508 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:19.226341 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:19.228664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-f5cb6809-cdb7-4fa7-8fff-1443e50e4148 req-91c7af5c-2e78-4305-9397-d5f80b563eb1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:19.229102 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-f5cb6809-cdb7-4fa7-8fff-1443e50e4148 req-91c7af5c-2e78-4305-9397-d5f80b563eb1 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:19.229808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:19.230620 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:19.231629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:19.232606 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:19.244918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-f5cb6809-cdb7-4fa7-8fff-1443e50e4148 req-91c7af5c-2e78-4305-9397-d5f80b563eb1 service nova] Creating event network-changed:c98f0a70-76c7-4798-9dfc-6e8275493f88 for instance d44bf150-cda8-482a-a0b9-f51d8070d972 on hv-cinder-84962 Jul 13 09:16:19.250321 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-f5cb6809-cdb7-4fa7-8fff-1443e50e4148 req-91c7af5c-2e78-4305-9397-d5f80b563eb1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037126 Jul 13 09:16:19.254227 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 518/997] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:16:19.263798 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:16:19.572820 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0d189c40-4cb7-4860-951a-bed1bb726307 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 204 len: 0 microversion: 2.1 time: 0.361700 Jul 13 09:16:19.573808 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 480/998] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:16:19 2022] DELETE /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:16:19.583417 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:19.590657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:19.592300 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:19.592693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:19.593634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:19.594099 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:19.896215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:19.903796 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-74a4782a-fb76-4e35-8131-32be4a04ac6e tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1448 microversion: 2.1 time: 0.325555 Jul 13 09:16:19.904678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 519/999] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:19 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1448 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:20.921775 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:20.922500 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:20.930185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:20.930625 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:20.931382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:20.931812 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:21.259554 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:21.267274 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a52a7930-0b8d-45ed-9261-8d64cd1b4771 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1448 microversion: 2.1 time: 0.349726 Jul 13 09:16:21.267930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 481/1000] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:20 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1448 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:21.700357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-07aa0443-fe3a-4cbb-8085-f88a27181950 req-0fa69d22-03d0-4598-b9e7-67de468bc85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44bf150-cda8-482a-a0b9-f51d8070d972", "name": "network-vif-deleted", "tag": "c98f0a70-76c7-4798-9dfc-6e8275493f88"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:21.709598 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-07aa0443-fe3a-4cbb-8085-f88a27181950 req-0fa69d22-03d0-4598-b9e7-67de468bc85f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:21.712644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-07aa0443-fe3a-4cbb-8085-f88a27181950 req-0fa69d22-03d0-4598-b9e7-67de468bc85f service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:21.720839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-07aa0443-fe3a-4cbb-8085-f88a27181950 req-0fa69d22-03d0-4598-b9e7-67de468bc85f service nova] Creating event network-vif-deleted:c98f0a70-76c7-4798-9dfc-6e8275493f88 for instance d44bf150-cda8-482a-a0b9-f51d8070d972 on hv-cinder-84962 Jul 13 09:16:21.725829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-07aa0443-fe3a-4cbb-8085-f88a27181950 req-0fa69d22-03d0-4598-b9e7-67de468bc85f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029169 Jul 13 09:16:21.726440 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 520/1001] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:22.285402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:22.286216 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:22.292793 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:22.293250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:22.294021 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:22.294486 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:22.363622 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9a75227440420fb3eab1685598f2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5574138d6341268eae22b78af64765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:22.372053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f7bf4a79-4db2-4873-9cf3-8d07fce9adf4 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 200 len: 1219 microversion: 2.1 time: 0.090741 Jul 13 09:16:22.372624 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 482/1002] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:22 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:23.390261 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:23.390982 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] [instance: d44bf150-cda8-482a-a0b9-f51d8070d972] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:23.397807 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:23.398280 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:23.399034 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:23.399464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:23.412435 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] HTTP exception thrown: Instance d44bf150-cda8-482a-a0b9-f51d8070d972 could not be found. Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Request method failure captured: Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 HTTP/1.1 Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizow1EHeuCjcfSy1A-Uim9msCMAFxC6HAjC8MrYeS3cHftVTgSyL6WmCtZNAoCfChVoCJS09y3MNJZ8OVULFkEUSXxxU-Z0-ivrCuf8sCXt3UMnRWfg2yUHdGxNTZg9T30Rq5RQPe0bqNCFtNIIkvHpyeD_Zq8OsS4Bl6IEURoCWkCxY Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 6b5574138d6341268eae22b78af64765 Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-TestShelveInstance-1353066268 Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:16:23.414011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6b5574138d6341268eae22b78af64765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6b5574138d6341268eae22b78af64765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6b5574138d6341268eae22b78af64765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6b5574138d6341268eae22b78af64765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-TestShelveInstance-1353066268 Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 6b5574138d6341268eae22b78af64765 Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-TestShelveInstance-1353066268 Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-TestShelveInstance-1353066268-project Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 0a9a75227440420fb3eab1685598f2dc Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-TestShelveInstance-1353066268-project Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance d44bf150-cda8-482a-a0b9-f51d8070d972 could not be found. Jul 13 09:16:23.415595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'd44bf150-cda8-482a-a0b9-f51d8070d972'} Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44bf150-cda8-482a-a0b9-f51d8070d972 could not be found. Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:23.416533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44bf150-cda8-482a-a0b9-f51d8070d972 could not be found. Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44bf150-cda8-482a-a0b9-f51d8070d972 could not be found. Jul 13 09:16:23.418093 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:23.419721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Returning 404 to user: Instance d44bf150-cda8-482a-a0b9-f51d8070d972 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:23.419721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6fe7c48b-24d5-4c24-b187-bd25ff3876f2 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972" status: 404 len: 111 microversion: 2.1 time: 0.029831 Jul 13 09:16:23.419721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 521/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:23 2022] GET /compute/v2.1/servers/d44bf150-cda8-482a-a0b9-f51d8070d972 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:16:23.672101 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-4f5d6bde-0b2e-4865-a713-3cb84cd8e4b0 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] Calling method '.version_select at 0x7fad222001f0>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:23.739700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-4f5d6bde-0b2e-4865-a713-3cb84cd8e4b0 tempest-TestShelveInstance-1353066268 tempest-TestShelveInstance-1353066268-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1052307799" status: 202 len: 0 microversion: 2.1 time: 0.070676 Jul 13 09:16:23.740073 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 483/1004] 10.222.0.40 () {58 vars in 1253 bytes} [Wed Jul 13 09:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1052307799 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:16:27.626545 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-0bfcb09a-7a63-46b4-b2be-dd3a0d605280 req-09219f3d-75ec-4e58-bba9-78c0b803f821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be6baa8-3d1d-4b03-ab21-b073f6f00dbc", "tag": "f6698d68-a4ae-4ad4-97a7-c02b13a8888c"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:27.631625 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:27.637761 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:27.647584 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:27.652360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:27.652360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:27.652360 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:27.658530 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-0bfcb09a-7a63-46b4-b2be-dd3a0d605280 req-09219f3d-75ec-4e58-bba9-78c0b803f821 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:27.658971 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-0bfcb09a-7a63-46b4-b2be-dd3a0d605280 req-09219f3d-75ec-4e58-bba9-78c0b803f821 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:27.671663 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-0bfcb09a-7a63-46b4-b2be-dd3a0d605280 req-09219f3d-75ec-4e58-bba9-78c0b803f821 service nova] Creating event network-changed:f6698d68-a4ae-4ad4-97a7-c02b13a8888c for instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc on hv-cinder-84962 Jul 13 09:16:27.678891 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-0bfcb09a-7a63-46b4-b2be-dd3a0d605280 req-09219f3d-75ec-4e58-bba9-78c0b803f821 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056297 Jul 13 09:16:27.681957 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 484/1005] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:27.684668 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:16:27.987359 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b3b7a572-45ec-4ce5-bd19-17da2b4a306a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 204 len: 0 microversion: 2.1 time: 0.367173 Jul 13 09:16:27.988056 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 522/1006] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:16:27 2022] DELETE /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:16:27.997034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:27.998142 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:28.006598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:28.007170 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:28.008041 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:28.008478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:28.233047 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:28.241461 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-2108e966-4e32-4c90-827f-41859211897a tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1576 microversion: 2.1 time: 0.248784 Jul 13 09:16:28.242313 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 485/1007] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:27 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:29.260445 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:29.261218 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:29.267993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:29.273633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:29.273633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:29.273633 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:29.407718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:29.415634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-10b13da2-6bfc-4eba-970f-a1cf0a30aff9 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1576 microversion: 2.1 time: 0.159385 Jul 13 09:16:29.416266 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 523/1008] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:29 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:30.433354 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:30.434703 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:30.442252 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:30.444910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:30.444910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:30.444910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:30.554155 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:30.562583 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e096f78c-6e16-4c95-b032-832bf4d7f469 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1390 microversion: 2.1 time: 0.133352 Jul 13 09:16:30.563166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 486/1009] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:30 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1390 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:30.647903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-7c971cd5-9434-45f8-a2b5-c0b049a57441 req-a664a635-7afa-44c1-9257-7f29a80e11f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be6baa8-3d1d-4b03-ab21-b073f6f00dbc", "name": "network-vif-deleted", "tag": "f6698d68-a4ae-4ad4-97a7-c02b13a8888c"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:30.657986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-7c971cd5-9434-45f8-a2b5-c0b049a57441 req-a664a635-7afa-44c1-9257-7f29a80e11f5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:30.658481 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-7c971cd5-9434-45f8-a2b5-c0b049a57441 req-a664a635-7afa-44c1-9257-7f29a80e11f5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:30.674963 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-7c971cd5-9434-45f8-a2b5-c0b049a57441 req-a664a635-7afa-44c1-9257-7f29a80e11f5 service nova] Creating event network-vif-deleted:f6698d68-a4ae-4ad4-97a7-c02b13a8888c for instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc on hv-cinder-84962 Jul 13 09:16:30.679973 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-7c971cd5-9434-45f8-a2b5-c0b049a57441 req-a664a635-7afa-44c1-9257-7f29a80e11f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037133 Jul 13 09:16:30.680594 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 524/1010] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:31.586457 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:31.587062 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:31.593812 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:31.594508 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:31.595268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:31.595869 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:31.636559 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:31.637034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:31.637488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lazy-loading 'fault' on Instance uuid 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:16:31.716921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:31.725810 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-74abefca-7f5d-47f5-afd6-8242a732b574 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 200 len: 1230 microversion: 2.1 time: 0.143452 Jul 13 09:16:31.735078 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 487/1011] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:31 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 1230 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:32.304857 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:32.305438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:32.312229 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:32.312675 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:32.313432 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:32.313861 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:32.339431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1d41fece-5a06-4d81-8cdd-d6ec430f87bd tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/ips" status: 200 len: 147 microversion: 2.1 time: 0.038681 Jul 13 09:16:32.339431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 525/1012] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:16:32 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:32.743268 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:32.743920 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:32.750780 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:32.751233 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:32.752002 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:32.752544 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:32.767823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] HTTP exception thrown: Instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc could not be found. Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Request method failure captured: Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc HTTP/1.1 Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoum7V30qQP4k4lIVCLvO_Gi3wU-AMNV_UoLTdCIi4ZTVS8T57FWL3ZlFf3LXdqPDEpZF3Ej7eaaUqJNYwEzazzoO_82XE9noBFRv4K1PWBQbQiQf3YnsrgmA01bXZlzCHysxN6opfra_IpHkyis3worO_RNpQ7_URWfNzXEfcW_b6k Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:16:32.769507 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02051a1f629a48199bb1eb504c747294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02051a1f629a48199bb1eb504c747294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 6f101dab08684c2483f67a9357efeae8 Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc could not be found. Jul 13 09:16:32.771521 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '9be6baa8-3d1d-4b03-ab21-b073f6f00dbc'} Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc could not be found. Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:32.772558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc could not be found. Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc could not be found. Jul 13 09:16:32.774184 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:32.775600 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Returning 404 to user: Instance 9be6baa8-3d1d-4b03-ab21-b073f6f00dbc could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:32.775600 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9126c884-5650-4ea8-973b-76532fb92228 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc" status: 404 len: 111 microversion: 2.1 time: 0.032949 Jul 13 09:16:32.775600 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 488/1013] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:32 2022] GET /compute/v2.1/servers/9be6baa8-3d1d-4b03-ab21-b073f6f00dbc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:16:33.986875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c368ae60-c7c0-4fe5-9628-05b1826f7cef"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:33.988099 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:33.995140 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:33.995583 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:33.996408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:33.996843 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:34.764208 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8dc98db8-dc4f-41c4-a9e7-7f7b7c8ef64f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781180 Jul 13 09:16:34.764823 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 526/1014] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:16:33 2022] POST /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:36.462266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:36.462800 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:36.465189 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-375e816c-ba51-4f4f-bb31-5ebaa7fed8c3 req-04c8c51f-94ab-4922-8a16-45637c4b9860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b9d222-8b85-4225-b1ff-02aaa569e511", "tag": "f0112888-5873-4829-b011-1ecd352cf3ac"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:36.469373 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:36.470020 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:36.470989 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:36.471420 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:36.473297 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-375e816c-ba51-4f4f-bb31-5ebaa7fed8c3 req-04c8c51f-94ab-4922-8a16-45637c4b9860 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:36.473764 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-375e816c-ba51-4f4f-bb31-5ebaa7fed8c3 req-04c8c51f-94ab-4922-8a16-45637c4b9860 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:36.484887 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-375e816c-ba51-4f4f-bb31-5ebaa7fed8c3 req-04c8c51f-94ab-4922-8a16-45637c4b9860 service nova] Creating event network-changed:f0112888-5873-4829-b011-1ecd352cf3ac for instance 57b9d222-8b85-4225-b1ff-02aaa569e511 on hv-cinder-84962 Jul 13 09:16:36.490516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-375e816c-ba51-4f4f-bb31-5ebaa7fed8c3 req-04c8c51f-94ab-4922-8a16-45637c4b9860 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029650 Jul 13 09:16:36.491349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 527/1015] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:16:36.498641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:16:36.810347 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-594d99d6-7a96-4077-9228-ad8b8144f349 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "DELETE /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 204 len: 0 microversion: 2.1 time: 0.351918 Jul 13 09:16:36.811220 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 489/1016] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:16:36 2022] DELETE /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:16:36.820416 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:36.821204 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:36.827661 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:36.828183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:36.829020 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:36.829462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:36.976206 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:36.984138 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-d9b6d89e-698e-40a7-848d-4c8fa54f26e3 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1578 microversion: 2.1 time: 0.168487 Jul 13 09:16:36.984780 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 528/1017] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:36 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:38.001224 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:38.001930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:38.009535 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:38.009999 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:38.010853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:38.011265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:38.155422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:38.163475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b76cbfba-2f34-44ef-b574-87c90fea0356 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1578 microversion: 2.1 time: 0.166547 Jul 13 09:16:38.164047 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 490/1018] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:37 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:38.771454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-65cb3030-ca5a-4a7d-b335-b8f4a74b9e3b req-ca7045a6-28e9-4120-a436-44a8a043865c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b9d222-8b85-4225-b1ff-02aaa569e511", "name": "network-vif-deleted", "tag": "f0112888-5873-4829-b011-1ecd352cf3ac"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:38.779859 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-65cb3030-ca5a-4a7d-b335-b8f4a74b9e3b req-ca7045a6-28e9-4120-a436-44a8a043865c service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:38.782345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-65cb3030-ca5a-4a7d-b335-b8f4a74b9e3b req-ca7045a6-28e9-4120-a436-44a8a043865c service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:38.791720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-65cb3030-ca5a-4a7d-b335-b8f4a74b9e3b req-ca7045a6-28e9-4120-a436-44a8a043865c service nova] Creating event network-vif-deleted:f0112888-5873-4829-b011-1ecd352cf3ac for instance 57b9d222-8b85-4225-b1ff-02aaa569e511 on hv-cinder-84962 Jul 13 09:16:38.796430 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-65cb3030-ca5a-4a7d-b335-b8f4a74b9e3b req-ca7045a6-28e9-4120-a436-44a8a043865c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029204 Jul 13 09:16:38.797004 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 529/1019] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:39.181478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:39.182131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:39.189321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:39.189755 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:39.190698 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:39.191207 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:39.258605 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f101dab08684c2483f67a9357efeae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02051a1f629a48199bb1eb504c747294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:39.266195 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1f085084-4da3-4f02-bf74-871da7f77353 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 200 len: 1226 microversion: 2.1 time: 0.089521 Jul 13 09:16:39.266763 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 491/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:39 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:40.284132 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:40.284833 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 57b9d222-8b85-4225-b1ff-02aaa569e511] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:40.291520 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:40.291972 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:40.292770 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:40.293212 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:40.306933 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] HTTP exception thrown: Instance 57b9d222-8b85-4225-b1ff-02aaa569e511 could not be found. Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Request method failure captured: Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 HTTP/1.1 Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoum7V30qQP4k4lIVCLvO_Gi3wU-AMNV_UoLTdCIi4ZTVS8T57FWL3ZlFf3LXdqPDEpZF3Ej7eaaUqJNYwEzazzoO_82XE9noBFRv4K1PWBQbQiQf3YnsrgmA01bXZlzCHysxN6opfra_IpHkyis3worO_RNpQ7_URWfNzXEfcW_b6k Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:16:40.308451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02051a1f629a48199bb1eb504c747294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02051a1f629a48199bb1eb504c747294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 6f101dab08684c2483f67a9357efeae8 Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 57b9d222-8b85-4225-b1ff-02aaa569e511 could not be found. Jul 13 09:16:40.309996 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '57b9d222-8b85-4225-b1ff-02aaa569e511'} Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b9d222-8b85-4225-b1ff-02aaa569e511 could not be found. Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:40.310944 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b9d222-8b85-4225-b1ff-02aaa569e511 could not be found. Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b9d222-8b85-4225-b1ff-02aaa569e511 could not be found. Jul 13 09:16:40.312406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.313718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Returning 404 to user: Instance 57b9d222-8b85-4225-b1ff-02aaa569e511 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:40.313718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7f2c1849-5a8b-4538-8b7e-8371333a6a4c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511" status: 404 len: 111 microversion: 2.1 time: 0.030479 Jul 13 09:16:40.313718 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 530/1021] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:40 2022] GET /compute/v2.1/servers/57b9d222-8b85-4225-b1ff-02aaa569e511 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:16:40.815642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:40.816143 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:40.822739 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:40.823191 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:40.823948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:40.824386 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:40.838471 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] HTTP exception thrown: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Request method failure captured: Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 HTTP/1.1 Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoum7V30qQP4k4lIVCLvO_Gi3wU-AMNV_UoLTdCIi4ZTVS8T57FWL3ZlFf3LXdqPDEpZF3Ej7eaaUqJNYwEzazzoO_82XE9noBFRv4K1PWBQbQiQf3YnsrgmA01bXZlzCHysxN6opfra_IpHkyis3worO_RNpQ7_URWfNzXEfcW_b6k Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:16:40.840055 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02051a1f629a48199bb1eb504c747294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02051a1f629a48199bb1eb504c747294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 6f101dab08684c2483f67a9357efeae8 Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.841750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '028cc5e6-e410-40e7-8327-d4dbe5b6c0d3'} Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:40.842741 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.844265 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.845827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Returning 404 to user: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:40.845827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dcbdafeb-6ffa-40e6-aa4c-723b94a79d9c tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "DELETE /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 404 len: 111 microversion: 2.1 time: 0.029675 Jul 13 09:16:40.845827 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 492/1022] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:16:40 2022] DELETE /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:16:40.850874 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:40.851627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] [instance: 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:40.857652 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:40.858104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:40.858862 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:40.859288 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:40.872898 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] HTTP exception thrown: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Request method failure captured: Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 HTTP/1.1 Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoum7V30qQP4k4lIVCLvO_Gi3wU-AMNV_UoLTdCIi4ZTVS8T57FWL3ZlFf3LXdqPDEpZF3Ej7eaaUqJNYwEzazzoO_82XE9noBFRv4K1PWBQbQiQf3YnsrgmA01bXZlzCHysxN6opfra_IpHkyis3worO_RNpQ7_URWfNzXEfcW_b6k Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:16:40.874456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02051a1f629a48199bb1eb504c747294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02051a1f629a48199bb1eb504c747294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02051a1f629a48199bb1eb504c747294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 02051a1f629a48199bb1eb504c747294 Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-TestVolumeBootPattern-1737401518 Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 6f101dab08684c2483f67a9357efeae8 Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-TestVolumeBootPattern-1737401518-project Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.876126 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '028cc5e6-e410-40e7-8327-d4dbe5b6c0d3'} Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:40.877028 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. Jul 13 09:16:40.878755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:40.880520 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Returning 404 to user: Instance 028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:40.880520 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-87ec3828-f391-41bf-8f08-8ea4fa0a9c95 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3" status: 404 len: 111 microversion: 2.1 time: 0.029559 Jul 13 09:16:40.880520 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 531/1023] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:40 2022] GET /compute/v2.1/servers/028cc5e6-e410-40e7-8327-d4dbe5b6c0d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 09:16:42.269412 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c368ae60-c7c0-4fe5-9628-05b1826f7cef"}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:42.270769 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:42.277029 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:42.277482 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:42.278285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:42.278733 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:42.366278 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Invalid volume: volume c368ae60-c7c0-4fe5-9628-05b1826f7cef is already attached to instances: 55aaee95-23bf-4d74-89b5-e798ff54172d Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: POST /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments HTTP/1.1 Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 74 Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:16:42.367930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {"volumeAttachment": {"volumeId": "c368ae60-c7c0-4fe5-9628-05b1826f7cef"}} Jul 13 09:16:42.369592 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Invalid volume: volume c368ae60-c7c0-4fe5-9628-05b1826f7cef is already attached to instances: 55aaee95-23bf-4d74-89b5-e798ff54172d Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'server_id': '55aaee95-23bf-4d74-89b5-e798ff54172d', 'body': {'volumeAttachment': {'volumeId': 'c368ae60-c7c0-4fe5-9628-05b1826f7cef'}}} Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c368ae60-c7c0-4fe5-9628-05b1826f7cef is already attached to instances: 55aaee95-23bf-4d74-89b5-e798ff54172d Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:42.370709 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c368ae60-c7c0-4fe5-9628-05b1826f7cef is already attached to instances: 55aaee95-23bf-4d74-89b5-e798ff54172d Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:42.372202 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c368ae60-c7c0-4fe5-9628-05b1826f7cef is already attached to instances: 55aaee95-23bf-4d74-89b5-e798ff54172d Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 400 to user: Invalid volume: volume c368ae60-c7c0-4fe5-9628-05b1826f7cef is already attached to instances: 55aaee95-23bf-4d74-89b5-e798ff54172d {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-96de78f7-0b34-4528-93cb-ed204de7b2f2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103912 Jul 13 09:16:42.374070 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 493/1024] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:16:42 2022] POST /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 09:16:42.412345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4f61d691-4777-4282-b45b-44c3cc23aba5 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] Calling method '.version_select at 0x7fad21b5ed30>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:42.434505 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:42.435136 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:42.442405 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:42.443148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:42.443662 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:42.444104 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:42.479936 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4f61d691-4777-4282-b45b-44c3cc23aba5 tempest-TestVolumeBootPattern-1737401518 tempest-TestVolumeBootPattern-1737401518-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2103770607" status: 202 len: 0 microversion: 2.1 time: 0.071716 Jul 13 09:16:42.481648 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 532/1025] 10.222.0.40 () {58 vars in 1262 bytes} [Wed Jul 13 09:16:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2103770607 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:16:42.531732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lazy-loading 'services' on Instance uuid 55aaee95-23bf-4d74-89b5-e798ff54172d {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:16:42.793899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b2cc1b12-54f6-477f-8957-c44747db1f50 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments/c368ae60-c7c0-4fe5-9628-05b1826f7cef" status: 202 len: 0 microversion: 2.1 time: 0.363360 Jul 13 09:16:42.794546 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 494/1026] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:16:42 2022] DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments/c368ae60-c7c0-4fe5-9628-05b1826f7cef => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 09:16:42.803712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:42.804947 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:42.812369 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:42.812905 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:42.813776 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:42.814316 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:42.844454 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1caa2290-50a1-478b-b97f-e6450678ce63 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Jul 13 09:16:42.845015 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 533/1027] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:16:42 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:43.857934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:43.859303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:43.865877 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:43.866435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:43.867273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:43.867782 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:43.871879 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:43.898419 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-54b43249-1670-4102-86eb-60093b7154d6 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045091 Jul 13 09:16:43.898834 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 495/1028] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:16:43 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:16:43.959044 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:43.960152 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:43.967260 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:43.967713 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:43.968526 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:43.969037 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:43.994868 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:16:44.283429 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-8c654eef-a032-417f-b59a-a42e286a8c13 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 204 len: 0 microversion: 2.1 time: 0.328514 Jul 13 09:16:44.284432 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 534/1029] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:16:43 2022] DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:16:44.292357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:44.293215 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:44.300032 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:44.300478 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:44.301416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:44.301998 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:44.457839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:44.465766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f3f860f6-bc38-4de7-a015-f64b27217d65 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1680 microversion: 2.1 time: 0.177211 Jul 13 09:16:44.466362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 496/1030] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:44 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:45.484829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:45.485451 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:45.491953 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:45.492400 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:45.493164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:45.493592 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:45.655295 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:45.667317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2fc4f1f9-4f66-4111-80b6-24164ac45c62 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1680 microversion: 2.1 time: 0.186572 Jul 13 09:16:45.669398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 535/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:45 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:46.684942 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:46.685567 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:46.693342 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:46.693804 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:46.694617 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:46.695063 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:46.901273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:46.908835 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8c4ebae7-4e4f-4baa-9cda-bddbe481cafa tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1680 microversion: 2.1 time: 0.227923 Jul 13 09:16:46.909404 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 497/1032] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:46 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:47.275272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-e40944bf-157c-4e9a-af4a-a79ecf6eb7f8 req-6b83fc17-774e-435a-884e-d446c1df1bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aaee95-23bf-4d74-89b5-e798ff54172d", "name": "network-vif-deleted", "tag": "e1329148-9041-40a5-847f-95e9f69b4fc6"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:47.287615 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-e40944bf-157c-4e9a-af4a-a79ecf6eb7f8 req-6b83fc17-774e-435a-884e-d446c1df1bd5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:47.288058 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-e40944bf-157c-4e9a-af4a-a79ecf6eb7f8 req-6b83fc17-774e-435a-884e-d446c1df1bd5 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:47.300684 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-e40944bf-157c-4e9a-af4a-a79ecf6eb7f8 req-6b83fc17-774e-435a-884e-d446c1df1bd5 service nova] Creating event network-vif-deleted:e1329148-9041-40a5-847f-95e9f69b4fc6 for instance 55aaee95-23bf-4d74-89b5-e798ff54172d on hv-cinder-84962 Jul 13 09:16:47.307772 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-e40944bf-157c-4e9a-af4a-a79ecf6eb7f8 req-6b83fc17-774e-435a-884e-d446c1df1bd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037353 Jul 13 09:16:47.308962 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 536/1033] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 13 09:16:47.926816 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:47.927453 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:47.938160 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:47.938867 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:47.939861 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:47.940588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:47.979677 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:47.980225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:47.981314 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lazy-loading 'fault' on Instance uuid 55aaee95-23bf-4d74-89b5-e798ff54172d {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:16:48.031218 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:48.039251 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-a113fcb5-9df2-4d96-ab30-608561608999 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 200 len: 1332 microversion: 2.1 time: 0.116226 Jul 13 09:16:48.040373 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 498/1034] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:47 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:49.059741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:49.060444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:49.066818 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:49.067273 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:49.068038 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:49.068473 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:49.072564 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:49.082720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d HTTP/1.1 Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:16:49.084503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:16:49.086182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '55aaee95-23bf-4d74-89b5-e798ff54172d'} Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:16:49.087033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:16:49.088302 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:16:49.089457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:16:49.089457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c020dab9-1747-450f-8fec-2de53a39e2cf tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 404 len: 111 microversion: 2.1 time: 0.030901 Jul 13 09:16:49.089457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 537/1035] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:49 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:16:49.094906 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8cf1fa8f-533e-4180-8fe7-56c9372c0a22 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '.version_select at 0x7fad21744d30>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:49.187749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8cf1fa8f-533e-4180-8fe7-56c9372c0a22 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260684561" status: 202 len: 0 microversion: 2.1 time: 0.096524 Jul 13 09:16:49.188256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 499/1036] 10.222.0.40 () {58 vars in 1220 bytes} [Wed Jul 13 09:16:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260684561 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:16:50.235260 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-2b711e42-a155-49e5-9414-8769540e35a2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: .version_select at 0x7fad26185dc0>, body: {"keypair": {"name": "tempest-keypair-594092256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcyke0yLQZIQ0uLXTmVW/gU+0j/lEwS8ejsdzJprR5px5DEczFiIbtEMUjmt8VJVWaaOXTGaQiXLAjXbxJWbNOs1CzZAV35UBbR+4dqejplkSmKFw02L3Vl3a0atdiaWw=="}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:50.242816 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:50.253217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-2b711e42-a155-49e5-9414-8769540e35a2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:16:50.257458 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-2b711e42-a155-49e5-9414-8769540e35a2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'key_pairs'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:16:50.385305 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-2b711e42-a155-49e5-9414-8769540e35a2 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154111 Jul 13 09:16:50.385916 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 538/1037] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Jul 13 09:16:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:52.764617 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-601140812", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0419ddd4-ade8-4500-ac9c-4682f59c8496"}], "security_groups": [{"name": "tempest-securitygroup--1854111550"}], "key_name": "tempest-keypair-594092256", "user_data": "}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:52.771921 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:16:52.866540 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] validate_networks() for [('0419ddd4-ade8-4500-ac9c-4682f59c8496', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:16:53.339152 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:16:53.339585 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:16:53.340206 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:16:53.340621 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:16:53.341034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:16:53.349936 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:53.350432 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:53.351225 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:53.351663 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:53.369177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:16:53.373110 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Getting quotas for user 47d7d837aafd4db7bf46346db8b399a6 and project 0486a8d3794f4b50a96d3477e14e344f. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:16:53.384822 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:16:53.387127 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:16:53.514820 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-cc8b2b83-4961-4bca-832c-7d8dd791e8b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.754989 Jul 13 09:16:53.515392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 500/1038] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:16:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:16:53.526046 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-356ff673-6d6b-4c7f-8045-3fec456bc473 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:53.526664 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-356ff673-6d6b-4c7f-8045-3fec456bc473 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:53.586502 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-356ff673-6d6b-4c7f-8045-3fec456bc473 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:53.593931 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-356ff673-6d6b-4c7f-8045-3fec456bc473 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1240 microversion: 2.1 time: 0.072485 Jul 13 09:16:53.594516 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 539/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:53 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:54.615655 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:54.616269 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:54.624515 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:54.624960 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:54.625726 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:54.626246 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:54.687651 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:54.695237 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-76d61750-d5dc-4daa-a2b9-3876268c8a4d tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1244 microversion: 2.1 time: 0.083965 Jul 13 09:16:54.695926 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 501/1040] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:54 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:55.712799 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:55.713960 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:55.720995 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:55.721657 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:55.724744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:55.724744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:55.790009 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:55.797540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b414a6ff-aa1d-4a33-8560-a0e568f13077 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1298 microversion: 2.1 time: 0.089341 Jul 13 09:16:55.798183 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 540/1041] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:55 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:56.815608 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:56.816209 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:56.822984 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:56.823700 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:56.824499 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:56.824938 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:57.019812 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:57.027240 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f74976fd-4219-48dd-96a1-ad386d22ca8a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.215958 Jul 13 09:16:57.027802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 502/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:56 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:57.259917 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-fb12dc58-76fa-4b28-ad7c-55ed6727892b req-1f98cbc6-04a4-4057-9be8-581483a8bb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b942614-217b-47b2-858b-d04eff124d5c", "tag": "355c5529-21f2-43d6-984d-dd34763cd07b"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:16:57.269762 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-fb12dc58-76fa-4b28-ad7c-55ed6727892b req-1f98cbc6-04a4-4057-9be8-581483a8bb6a service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:57.270235 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-fb12dc58-76fa-4b28-ad7c-55ed6727892b req-1f98cbc6-04a4-4057-9be8-581483a8bb6a service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:57.283117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-fb12dc58-76fa-4b28-ad7c-55ed6727892b req-1f98cbc6-04a4-4057-9be8-581483a8bb6a service nova] Creating event network-changed:355c5529-21f2-43d6-984d-dd34763cd07b for instance 2b942614-217b-47b2-858b-d04eff124d5c on hv-cinder-84962 Jul 13 09:16:57.289243 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-fb12dc58-76fa-4b28-ad7c-55ed6727892b req-1f98cbc6-04a4-4057-9be8-581483a8bb6a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166850 Jul 13 09:16:57.289759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 541/1043] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:16:58.044085 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:58.044704 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:58.051230 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:58.051684 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:58.052451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:58.052930 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:58.181966 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:58.189210 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-da5f7382-2409-4c06-8bef-ed1e1be06788 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.149060 Jul 13 09:16:58.189769 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 503/1044] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:58 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:16:59.207629 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:16:59.208323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:16:59.215114 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:59.215561 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:59.216325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:16:59.216764 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:16:59.345566 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:16:59.353965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-44a715c7-4e11-4d1d-b55e-40bdf55c87e0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.151097 Jul 13 09:16:59.354563 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 542/1045] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:16:59 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:00.371402 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:00.372053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:00.378260 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:00.378710 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:00.379784 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:00.380183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:00.779308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:00.786680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-ea5fda55-4b8e-4a73-9c32-9f37d64d443b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.419120 Jul 13 09:17:00.787262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 504/1046] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:00 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:01.805311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:01.805930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:01.812442 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:01.812889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:01.813648 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:01.814112 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:01.943378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:01.951124 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0a27767e-de46-4025-be22-6a1d84374af1 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.150316 Jul 13 09:17:01.951688 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 543/1047] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:01 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:02.600629 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-0667bcd3-d225-48d1-b283-e1077a019880 req-92afa2b8-dd77-4d36-bf7d-0b99b96c0d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b942614-217b-47b2-858b-d04eff124d5c", "name": "network-vif-plugged", "status": "completed", "tag": "355c5529-21f2-43d6-984d-dd34763cd07b"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:17:02.608935 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-0667bcd3-d225-48d1-b283-e1077a019880 req-92afa2b8-dd77-4d36-bf7d-0b99b96c0d04 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:02.609382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-0667bcd3-d225-48d1-b283-e1077a019880 req-92afa2b8-dd77-4d36-bf7d-0b99b96c0d04 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:02.620497 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-0667bcd3-d225-48d1-b283-e1077a019880 req-92afa2b8-dd77-4d36-bf7d-0b99b96c0d04 service nova] Creating event network-vif-plugged:355c5529-21f2-43d6-984d-dd34763cd07b for instance 2b942614-217b-47b2-858b-d04eff124d5c on hv-cinder-84962 Jul 13 09:17:02.625416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-0667bcd3-d225-48d1-b283-e1077a019880 req-92afa2b8-dd77-4d36-bf7d-0b99b96c0d04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088157 Jul 13 09:17:02.626017 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 505/1048] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:17:02.968270 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:02.968910 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:02.975711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:02.976157 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:02.976900 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:02.977328 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:03.105622 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:03.112893 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-56358c3c-3487-4ad1-8e8d-a6dd46d47e10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.148670 Jul 13 09:17:03.113457 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 544/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:02 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:04.126561 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:04.127334 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:04.132317 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:04.133018 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:04.139292 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:04.139746 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:04.140519 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:04.140955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:04.274824 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:04.282904 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6c1085a0-6f5a-4199-82cf-9d26c3624f0f tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1366 microversion: 2.1 time: 0.157133 Jul 13 09:17:04.283593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 506/1050] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:04 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:05.299775 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:05.300391 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:05.302368 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:05.308171 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:05.309828 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:05.309828 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:05.309828 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:05.439174 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:05.446744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0547e413-0cb8-4ad5-ab93-67d5ead0a9c0 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1554 microversion: 2.1 time: 0.150803 Jul 13 09:17:05.447311 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 545/1051] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:05 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:05.462722 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:05.463247 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:05.470205 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:05.470660 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:05.471426 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:05.471882 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:05.547728 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7c9c919a-e674-4849-910d-58b55dff7835 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088743 Jul 13 09:17:05.548323 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 507/1052] 10.222.0.40 () {58 vars in 1274 bytes} [Wed Jul 13 09:17:05 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:17:06.516739 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-038ae035-382a-45fc-b8ac-3285044377b6 req-3cd73ffa-edea-4a9b-868f-0c87c7d645df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b942614-217b-47b2-858b-d04eff124d5c", "tag": "355c5529-21f2-43d6-984d-dd34763cd07b"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:17:06.525930 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-038ae035-382a-45fc-b8ac-3285044377b6 req-3cd73ffa-edea-4a9b-868f-0c87c7d645df service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:06.526405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-038ae035-382a-45fc-b8ac-3285044377b6 req-3cd73ffa-edea-4a9b-868f-0c87c7d645df service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:06.537460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-038ae035-382a-45fc-b8ac-3285044377b6 req-3cd73ffa-edea-4a9b-868f-0c87c7d645df service nova] Creating event network-changed:355c5529-21f2-43d6-984d-dd34763cd07b for instance 2b942614-217b-47b2-858b-d04eff124d5c on hv-cinder-84962 Jul 13 09:17:06.547785 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-038ae035-382a-45fc-b8ac-3285044377b6 req-3cd73ffa-edea-4a9b-868f-0c87c7d645df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030786 Jul 13 09:17:06.547785 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 546/1053] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:17:40.433577 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:40.434415 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=62 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:40.438270 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:40.438766 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:40.444576 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:40.448972 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:40.448972 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:40.448972 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:40.472198 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-77686de0-9c0a-46b9-8bf8-f3a05c0f9959 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/ips" status: 200 len: 148 microversion: 2.1 time: 0.040078 Jul 13 09:17:40.472893 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 508/1054] 10.222.0.40 () {58 vars in 1247 bytes} [Wed Jul 13 09:17:40 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:17:42.017238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf528ed-8bc5-4b75-89e0-217f8ee316f5"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:17:42.018408 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:42.020761 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:42.021544 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=34 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:17:42.027166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:42.031077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:42.031077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:42.031077 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:42.789324 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-7483ac15-0996-4c85-a96d-91adba3cd811 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "POST /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776210 Jul 13 09:17:42.789942 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 547/1055] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Jul 13 09:17:42 2022] POST /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:17:50.372276 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:50.372811 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:50.380025 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:50.380481 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:50.381243 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:50.381684 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:50.460357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lazy-loading 'services' on Instance uuid 2b942614-217b-47b2-858b-d04eff124d5c {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:17:50.713934 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dcdc01ba-d70f-4ad4-9d72-f743fc51f73b tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments/2bf528ed-8bc5-4b75-89e0-217f8ee316f5" status: 202 len: 0 microversion: 2.1 time: 0.345530 Jul 13 09:17:50.714596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 509/1056] 10.222.0.40 () {58 vars in 1415 bytes} [Wed Jul 13 09:17:50 2022] DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments/2bf528ed-8bc5-4b75-89e0-217f8ee316f5 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:17:50.723964 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:50.725051 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:50.731948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:50.732399 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:50.733164 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:50.733602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:50.762883 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c2480aad-911f-4873-b9c5-49fb2db1e376 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Jul 13 09:17:50.763438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 548/1057] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:17:50 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:17:51.776456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:51.777474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:51.783655 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:51.784098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:51.784848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:51.785279 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:51.813266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b9d040ff-d64a-466d-af0c-3997bf51b903 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042303 Jul 13 09:17:51.813809 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 510/1058] 10.222.0.40 () {58 vars in 1301 bytes} [Wed Jul 13 09:17:51 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 09:17:51.870467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:51.870948 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:51.877272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:51.877976 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:51.878757 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:51.879193 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:51.905161 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:17:52.193544 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c4771464-4084-49a6-8e8c-b9a95b374b01 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 204 len: 0 microversion: 2.1 time: 0.326955 Jul 13 09:17:52.194182 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 549/1059] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:17:51 2022] DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:17:52.203019 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:52.203626 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:52.209628 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:52.212781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:52.212781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:52.212781 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:52.340870 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:52.348669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-29b7025c-7fd6-447c-ac36-1e5b74d19e49 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1679 microversion: 2.1 time: 0.149506 Jul 13 09:17:52.349241 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 511/1060] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:52 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:53.366655 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:53.367349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:53.373975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:53.374456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:53.375208 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:53.375634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:53.509012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:53.518272 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0131c0b3-fb39-43d5-8476-db3a8294eb91 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1679 microversion: 2.1 time: 0.155914 Jul 13 09:17:53.518875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 550/1061] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:53 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:17:54.536142 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:54.536783 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:54.544106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:54.544574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:54.545363 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:54.545802 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:54.578386 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-e1a026db-d118-4641-8c43-ba7f9c9493e8 req-cf7d561b-5ac2-4e4d-be34-b44bccd85e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b942614-217b-47b2-858b-d04eff124d5c", "name": "network-vif-deleted", "tag": "355c5529-21f2-43d6-984d-dd34763cd07b"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:17:54.586145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-e1a026db-d118-4641-8c43-ba7f9c9493e8 req-cf7d561b-5ac2-4e4d-be34-b44bccd85e26 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:54.591565 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-e1a026db-d118-4641-8c43-ba7f9c9493e8 req-cf7d561b-5ac2-4e4d-be34-b44bccd85e26 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:54.612443 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d7d837aafd4db7bf46346db8b399a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0486a8d3794f4b50a96d3477e14e344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:17:54.622336 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c5c28cd3-d20e-428c-98e9-cffd84f88615 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 200 len: 1611 microversion: 2.1 time: 0.089849 Jul 13 09:17:54.623012 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 512/1062] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:54 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 1611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:17:54.777292 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-e1a026db-d118-4641-8c43-ba7f9c9493e8 req-cf7d561b-5ac2-4e4d-be34-b44bccd85e26 service nova] Creating event network-vif-deleted:355c5529-21f2-43d6-984d-dd34763cd07b for instance 2b942614-217b-47b2-858b-d04eff124d5c on hv-cinder-84962 Jul 13 09:17:54.783350 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-e1a026db-d118-4641-8c43-ba7f9c9493e8 req-cf7d561b-5ac2-4e4d-be34-b44bccd85e26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209471 Jul 13 09:17:54.784245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 551/1063] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 09:17:55.640327 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:55.640872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:55.647450 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:55.647895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:55.648648 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:55.649080 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:55.662524 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c HTTP/1.1 Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:17:55.664164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:55.666355 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '2b942614-217b-47b2-858b-d04eff124d5c'} Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:55.670362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:55.672037 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:55.673428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:55.673428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-00b9d2b7-09ba-4b36-9183-ab7e5a30ec10 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 404 len: 111 microversion: 2.1 time: 0.029227 Jul 13 09:17:55.673428 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 513/1064] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:55 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:17:55.675910 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-6acd1d07-216e-4d4d-a96e-b6005ceae861 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '.version_select at 0x7fad2605df70>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:55.741279 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-6acd1d07-216e-4d4d-a96e-b6005ceae861 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594092256" status: 202 len: 0 microversion: 2.1 time: 0.069353 Jul 13 09:17:55.741817 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 552/1065] 10.222.0.40 () {58 vars in 1217 bytes} [Wed Jul 13 09:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594092256 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 09:17:57.770279 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:57.770796 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:57.777256 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:57.777706 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:57.778519 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:57.778960 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:57.792842 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c HTTP/1.1 Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:17:57.794446 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.796033 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '2b942614-217b-47b2-858b-d04eff124d5c'} Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:57.796940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.798558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.799977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:57.799977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f6523670-3d13-4938-a931-54dad2ff361c tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 404 len: 111 microversion: 2.1 time: 0.029433 Jul 13 09:17:57.799977 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 514/1066] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:17:57 2022] DELETE /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:17:57.803984 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:57.804709 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 2b942614-217b-47b2-858b-d04eff124d5c] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:57.812464 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:57.812907 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:57.813656 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:57.814109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:57.826831 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c HTTP/1.1 Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:17:57.828420 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.830013 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '2b942614-217b-47b2-858b-d04eff124d5c'} Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:57.830955 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. Jul 13 09:17:57.832438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:57.834002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 2b942614-217b-47b2-858b-d04eff124d5c could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:57.834002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-4ec98829-1a81-4bb6-817a-3e06de1bb8a4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jul 13 09:17:57.834002 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 553/1067] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:57 2022] GET /compute/v2.1/servers/2b942614-217b-47b2-858b-d04eff124d5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:17:59.101949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:59.102467 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:59.108903 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.109354 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.110135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.110571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.124178 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d HTTP/1.1 Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:17:59.125694 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.127379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '55aaee95-23bf-4d74-89b5-e798ff54172d'} Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:59.128456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.129801 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.131066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:59.131066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-73f9ee37-a418-4f5d-9414-1cd3da89d2a3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 404 len: 111 microversion: 2.1 time: 0.028994 Jul 13 09:17:59.131066 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 515/1068] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:17:59 2022] DELETE /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:17:59.137024 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:59.137634 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 55aaee95-23bf-4d74-89b5-e798ff54172d] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:59.144043 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.144491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.145248 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.145684 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.158868 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d HTTP/1.1 Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:17:59.160378 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.161980 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '55aaee95-23bf-4d74-89b5-e798ff54172d'} Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:59.163012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. Jul 13 09:17:59.164503 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.165951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 55aaee95-23bf-4d74-89b5-e798ff54172d could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:59.165951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b46a94ec-6f29-44f4-834b-5af249315052 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d" status: 404 len: 111 microversion: 2.1 time: 0.029681 Jul 13 09:17:59.165951 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 554/1069] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:59 2022] GET /compute/v2.1/servers/55aaee95-23bf-4d74-89b5-e798ff54172d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:17:59.170716 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:59.171236 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:59.177156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.177596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.178382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.178817 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.193129 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 HTTP/1.1 Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:17:59.194764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.196394 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '644fc77e-64b1-4f38-9832-4cf3f5acea52'} Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:59.197852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.199303 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.200575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:59.200575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-abe64bc2-932c-47bc-a953-c9bac597c2c3 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 404 len: 111 microversion: 2.1 time: 0.029841 Jul 13 09:17:59.200575 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 516/1070] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:17:59 2022] DELETE /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:17:59.205122 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:17:59.205733 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: 644fc77e-64b1-4f38-9832-4cf3f5acea52] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:17:59.211716 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.212162 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.212942 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:17:59.213490 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:17:59.226540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 HTTP/1.1 Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:17:59.228047 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.230194 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '644fc77e-64b1-4f38-9832-4cf3f5acea52'} Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:17:59.231069 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. Jul 13 09:17:59.232337 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:17:59.233443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance 644fc77e-64b1-4f38-9832-4cf3f5acea52 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:17:59.233443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-90eedd5d-922d-4bf1-b0ed-a89921d8a931 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52" status: 404 len: 111 microversion: 2.1 time: 0.029001 Jul 13 09:17:59.233443 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 555/1071] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:17:59 2022] GET /compute/v2.1/servers/644fc77e-64b1-4f38-9832-4cf3f5acea52 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:18:00.501848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:00.502378 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:00.509163 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:00.510267 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:00.511034 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:00.511475 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:00.524948 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 HTTP/1.1 Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:18:00.526732 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.528447 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': 'ec2037c6-2367-4a79-8c54-1455e09e6280'} Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:18:00.529377 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.530872 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.532266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:18:00.532266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7a021b7f-6b9c-4bd9-a2b2-d24890ebe96a tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 404 len: 111 microversion: 2.1 time: 0.030062 Jul 13 09:18:00.532266 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 517/1072] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:18:00 2022] DELETE /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:18:00.536428 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:00.537031 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] [instance: ec2037c6-2367-4a79-8c54-1455e09e6280] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:00.543539 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:00.543986 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:00.544735 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:00.545165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:00.558428 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] HTTP exception thrown: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Request method failure captured: Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 HTTP/1.1 Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizoygPBeHNy-QW-HZFsldGiq0NXwrwDCDVs1fvyvH5eT9AELgRwp_Cdi1i3wDbaUGfoLeuMCOlyZSIjaWhLr6_SP0ZmEdKB53vRtHW7m7byBz3r8lG65VDCnRX7fOaGjC7E7gvlMvhL0H5v5cFJS9yw3hfvBVTeZfZSGyN8PCDhSvtYw Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:18:00.559937 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0486a8d3794f4b50a96d3477e14e344f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 0486a8d3794f4b50a96d3477e14e344f Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079300296 Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 47d7d837aafd4db7bf46346db8b399a6 Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-AttachVolumeNegativeTest-2079300296-project Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.561491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'ec2037c6-2367-4a79-8c54-1455e09e6280'} Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:18:00.562570 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. Jul 13 09:18:00.564057 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:00.565525 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] Returning 404 to user: Instance ec2037c6-2367-4a79-8c54-1455e09e6280 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:18:00.565525 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-b0fc0a51-cec9-44d5-ad76-8e76fe13d0b4 tempest-AttachVolumeNegativeTest-2079300296 tempest-AttachVolumeNegativeTest-2079300296-project] 10.222.0.40 "GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280" status: 404 len: 111 microversion: 2.1 time: 0.028730 Jul 13 09:18:00.565525 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 556/1073] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:00 2022] GET /compute/v2.1/servers/ec2037c6-2367-4a79-8c54-1455e09e6280 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:18:19.483602 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1656355071", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "networks": [{"uuid": "c8a7814d-cee4-4229-888f-bbba5c8b4ee3"}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:19.490560 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=20 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:19.491294 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:19.536578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] validate_networks() for [('c8a7814d-cee4-4229-888f-bbba5c8b4ee3', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:18:19.876636 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:18:19.877319 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:18:19.877791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:18:19.878250 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:18:19.878664 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:18:19.887332 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:19.888016 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:19.888821 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:19.889262 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:19.905569 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Getting quotas for project 8a83c88f502a46e0bf36ce97e86398ce. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:18:19.909509 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Getting quotas for user 043c93f3631a458d98654fae9140807a and project 8a83c88f502a46e0bf36ce97e86398ce. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:18:19.920946 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:18:19.923194 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:18:20.077277 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-1853ec20-6695-46a0-9db5-11902d9270c4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598311 Jul 13 09:18:20.077919 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 518/1074] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:18:20.087767 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-aa77f23c-1b10-42d7-94c2-2b32c849a0b8 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:20.088403 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-aa77f23c-1b10-42d7-94c2-2b32c849a0b8 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:20.091117 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:20.091754 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:20.145600 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-aa77f23c-1b10-42d7-94c2-2b32c849a0b8 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:20.153301 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-aa77f23c-1b10-42d7-94c2-2b32c849a0b8 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1214 microversion: 2.1 time: 0.069301 Jul 13 09:18:20.154026 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 557/1075] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:20 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:21.171418 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:21.172076 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:21.178255 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:21.178707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:21.179498 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:21.179929 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:21.243232 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:21.251707 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-bb811e8b-0803-43bb-9d29-58da6fdf14ae tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1218 microversion: 2.1 time: 0.085526 Jul 13 09:18:21.252544 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 519/1076] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:21 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:22.270135 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:22.270750 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:22.279145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:22.279502 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:22.280262 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:22.280693 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:22.342863 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:22.351061 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-660f061a-e6be-40ed-bdd3-7026bf2a3eab tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1284 microversion: 2.1 time: 0.085771 Jul 13 09:18:22.351692 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 558/1077] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:22 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:23.368940 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:23.369649 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:23.377140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:23.377605 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:23.378406 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:23.378927 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:23.572859 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:23.580598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-66ec3ffa-01ae-4489-a445-8d5dead953f4 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.215589 Jul 13 09:18:23.581177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 520/1078] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:23 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:24.019351 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-29fc62c5-f87f-471c-b7e2-3c40f5f411f0 req-4e7e9b12-bd32-46dd-98c7-ee130090d916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9380bff5-e18a-4e69-a1d8-47e44c636eaa", "tag": "145d3aa0-2376-47da-8a4e-fa10b0ab9436"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:24.029253 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-29fc62c5-f87f-471c-b7e2-3c40f5f411f0 req-4e7e9b12-bd32-46dd-98c7-ee130090d916 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:24.029699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-29fc62c5-f87f-471c-b7e2-3c40f5f411f0 req-4e7e9b12-bd32-46dd-98c7-ee130090d916 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:24.040479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-29fc62c5-f87f-471c-b7e2-3c40f5f411f0 req-4e7e9b12-bd32-46dd-98c7-ee130090d916 service nova] Creating event network-changed:145d3aa0-2376-47da-8a4e-fa10b0ab9436 for instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa on hv-cinder-84962 Jul 13 09:18:24.046178 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-29fc62c5-f87f-471c-b7e2-3c40f5f411f0 req-4e7e9b12-bd32-46dd-98c7-ee130090d916 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031716 Jul 13 09:18:24.046790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 559/1079] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:18:24.597340 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:24.597949 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:24.604317 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:24.604759 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:24.605516 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:24.605970 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:24.785987 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:24.793434 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-6a20bda7-91cb-466b-9670-98c165e3c78f tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.200014 Jul 13 09:18:24.794166 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 521/1080] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:24 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:25.811768 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:25.812460 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:25.818729 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:25.819163 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:25.819921 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:25.820349 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:25.952332 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:25.959725 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-9b96c76d-bd4d-4d43-87ff-172d4316bf52 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.152978 Jul 13 09:18:25.960294 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 560/1081] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:25 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:26.976910 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:26.977455 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:26.984273 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:26.984791 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:26.985564 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:26.986000 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:27.116467 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:27.124928 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-258aac86-1b1e-4383-bcf0-fee0fd4bb3d7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.152045 Jul 13 09:18:27.125737 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 522/1082] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:26 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:28.142845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:28.143459 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:28.149997 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:28.150479 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:28.151238 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:28.151676 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:28.278405 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:28.286648 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-49be542f-7239-46e4-a44d-78f26defe5c3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.148294 Jul 13 09:18:28.287217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 561/1083] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:28 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:28.934839 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-2285da4a-d8fe-46f3-9db2-290f4ccfcc3b req-e16f6d53-6704-4825-8591-1f98cfeba4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9380bff5-e18a-4e69-a1d8-47e44c636eaa", "name": "network-vif-plugged", "status": "completed", "tag": "145d3aa0-2376-47da-8a4e-fa10b0ab9436"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:28.943854 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2285da4a-d8fe-46f3-9db2-290f4ccfcc3b req-e16f6d53-6704-4825-8591-1f98cfeba4e3 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:28.944296 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-2285da4a-d8fe-46f3-9db2-290f4ccfcc3b req-e16f6d53-6704-4825-8591-1f98cfeba4e3 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:28.955598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-2285da4a-d8fe-46f3-9db2-290f4ccfcc3b req-e16f6d53-6704-4825-8591-1f98cfeba4e3 service nova] Creating event network-vif-plugged:145d3aa0-2376-47da-8a4e-fa10b0ab9436 for instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa on hv-cinder-84962 Jul 13 09:18:28.960764 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-2285da4a-d8fe-46f3-9db2-290f4ccfcc3b req-e16f6d53-6704-4825-8591-1f98cfeba4e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029648 Jul 13 09:18:28.961451 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 523/1084] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:18:29.304027 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:29.305373 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:29.312515 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:29.315342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:29.315342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:29.315342 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:29.445739 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:29.453977 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-5fdf877b-68a8-48b9-a2d0-140314141777 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.153775 Jul 13 09:18:29.454561 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 562/1085] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:29 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:30.468828 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:30.469574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:30.474053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:30.475609 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:30.481051 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:30.481491 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:30.482474 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:30.482984 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:30.614838 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:30.622308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d147525e-bf2d-49fb-857d-6ddbce2bfb8d tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1314 microversion: 2.1 time: 0.154342 Jul 13 09:18:30.623362 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 524/1086] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:30 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:31.640568 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:31.641217 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:31.643204 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:31.648979 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:31.649413 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:31.650345 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:31.650782 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:31.789277 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:31.797215 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-676dce91-1b4a-4529-8509-a6bb7db2d0f7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1499 microversion: 2.1 time: 0.160920 Jul 13 09:18:31.799957 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 563/1087] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:31 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:32.652382 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:32.655578 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:32.659749 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:32.660228 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:32.660994 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:32.661431 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:32.734523 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:18:33.013012 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-f29a1728-8ef3-47bb-938f-d6d0cee9bbe7 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 204 len: 0 microversion: 2.1 time: 0.364175 Jul 13 09:18:33.013605 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 525/1088] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:18:32 2022] DELETE /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:18:33.021590 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:33.022242 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:33.028706 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:33.029153 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:33.029913 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:33.030970 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:33.160176 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:33.167603 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e48a304d-c893-4d8f-a5a9-597f2dc9244c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1505 microversion: 2.1 time: 0.149793 Jul 13 09:18:33.168294 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 564/1089] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:33 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:34.185895 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:34.186899 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:34.193152 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:34.193596 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:34.194393 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:34.194830 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:34.358603 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:34.366289 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-e0a796a1-8f57-457c-8779-3f22afd7ea23 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1505 microversion: 2.1 time: 0.184633 Jul 13 09:18:34.366853 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 526/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:34 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:34.849897 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-f9ef6942-e8d7-4b1b-86b3-7b799a970090 req-d689dbfd-8e4d-416c-bc16-7d5c631d80d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9380bff5-e18a-4e69-a1d8-47e44c636eaa", "name": "network-vif-deleted", "tag": "145d3aa0-2376-47da-8a4e-fa10b0ab9436"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:34.858897 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-f9ef6942-e8d7-4b1b-86b3-7b799a970090 req-d689dbfd-8e4d-416c-bc16-7d5c631d80d9 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:34.859396 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-f9ef6942-e8d7-4b1b-86b3-7b799a970090 req-d689dbfd-8e4d-416c-bc16-7d5c631d80d9 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:34.870390 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-f9ef6942-e8d7-4b1b-86b3-7b799a970090 req-d689dbfd-8e4d-416c-bc16-7d5c631d80d9 service nova] Creating event network-vif-deleted:145d3aa0-2376-47da-8a4e-fa10b0ab9436 for instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa on hv-cinder-84962 Jul 13 09:18:34.875873 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-f9ef6942-e8d7-4b1b-86b3-7b799a970090 req-d689dbfd-8e4d-416c-bc16-7d5c631d80d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029517 Jul 13 09:18:34.876468 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 565/1091] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:18:35.383860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:35.384464 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:35.392100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:35.392100 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:35.392740 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:35.393169 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:35.422837 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:35.423280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:35.423723 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lazy-loading 'fault' on Instance uuid 9380bff5-e18a-4e69-a1d8-47e44c636eaa {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:18:35.468011 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:35.475536 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-691af1b7-5fb0-4087-8c7c-c5aa5236307b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 200 len: 1304 microversion: 2.1 time: 0.095527 Jul 13 09:18:35.476115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 527/1092] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:35 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:36.493540 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:36.494403 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 9380bff5-e18a-4e69-a1d8-47e44c636eaa] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:36.502196 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:36.502645 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:36.503404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:36.503839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:36.517106 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] HTTP exception thrown: Instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa could not be found. Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Request method failure captured: Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa HTTP/1.1 Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizo3ZhmFsFPWaDmssdY58kLcgtnobnWeAKhkHq6kK3q1t6Kr4zxlxyw0Xb4Z_1-zWGG9YNnVuNySwH5agIvqBmg5jEmsAg4k0psepzFd6uRmy3e69-ZydAVRGCVNeDyZ_s4DtY-K_l3_Pbj_jUvX11CmZ_DAhp0rwqJUcWVrtSMFeBe8 Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: 8a83c88f502a46e0bf36ce97e86398ce Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesActionsTest-1432956727 Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:18:36.518744 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesActionsTest-1432956727 Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: 8a83c88f502a46e0bf36ce97e86398ce Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesActionsTest-1432956727 Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesActionsTest-1432956727-project Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 043c93f3631a458d98654fae9140807a Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesActionsTest-1432956727-project Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa could not be found. Jul 13 09:18:36.520444 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': '9380bff5-e18a-4e69-a1d8-47e44c636eaa'} Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa could not be found. Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:18:36.521436 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa could not be found. Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa could not be found. Jul 13 09:18:36.523066 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:18:36.524606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Returning 404 to user: Instance 9380bff5-e18a-4e69-a1d8-47e44c636eaa could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:18:36.524606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3c65c6e2-be5a-4b82-b5ea-acb6c9963510 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa" status: 404 len: 111 microversion: 2.1 time: 0.030811 Jul 13 09:18:36.524606 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 566/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:36 2022] GET /compute/v2.1/servers/9380bff5-e18a-4e69-a1d8-47e44c636eaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:18:36.567945 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-620815755", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452", "networks": [{"uuid": "c8a7814d-cee4-4229-888f-bbba5c8b4ee3"}]}} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:36.621149 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.network.neutron [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] validate_networks() for [('c8a7814d-cee4-4229-888f-bbba5c8b4ee3', None, None, None, None, None)] {{(pid=118253) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:18:36.960164 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Flavor limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:18:36.960598 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Image limits 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:18:36.961092 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Flavor pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:18:36.961503 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Image pref 0:0:0 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:18:36.961916 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.virt.hardware [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:18:36.970745 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:36.971191 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:36.972018 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:36.972454 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:36.989156 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Getting quotas for project 8a83c88f502a46e0bf36ce97e86398ce. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:18:36.993012 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.quota [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Getting quotas for user 043c93f3631a458d98654fae9140807a and project 8a83c88f502a46e0bf36ce97e86398ce. Resources: {'ram', 'cores', 'instances'} {{(pid=118253) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:18:37.004779 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Going to run 1 instances... {{(pid=118253) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:18:37.007040 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:18:37.137195 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-868a3f4f-746f-416e-825d-7933566abd6e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573092 Jul 13 09:18:37.138734 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 528/1094] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:18:37.148088 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bfae004d-a4db-42bb-82ab-19013ac28658 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:37.148845 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bfae004d-a4db-42bb-82ab-19013ac28658 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:37.204323 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bfae004d-a4db-42bb-82ab-19013ac28658 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:37.211145 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bfae004d-a4db-42bb-82ab-19013ac28658 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1213 microversion: 2.1 time: 0.066999 Jul 13 09:18:37.211720 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 567/1095] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:37 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:38.228192 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:38.228834 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:38.235738 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:38.236275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:38.237026 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:38.237456 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:38.302942 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:38.310389 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-afc6ad2a-34d3-46b4-8bfe-54a649036b77 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1209 microversion: 2.1 time: 0.086492 Jul 13 09:18:38.310955 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 529/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:38 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:39.328949 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:39.329914 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:39.336598 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:39.337049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:39.337825 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:39.338283 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:39.409434 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:39.417712 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1acb7af5-0853-4262-83b1-bad28a1d436a tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1271 microversion: 2.1 time: 0.093113 Jul 13 09:18:39.422339 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 568/1097] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:39 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:40.403756 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-a1d83f01-2db1-4035-8de8-fff8236e5212 req-0da4afe6-4b8f-442d-9975-257eb96e1737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3186bab8-b4eb-4837-96f2-6ebfc27c32e2", "tag": "6e292236-e930-4928-8ac9-c1257341443a"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:40.412657 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-a1d83f01-2db1-4035-8de8-fff8236e5212 req-0da4afe6-4b8f-442d-9975-257eb96e1737 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:40.413102 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-a1d83f01-2db1-4035-8de8-fff8236e5212 req-0da4afe6-4b8f-442d-9975-257eb96e1737 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:40.425098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-a1d83f01-2db1-4035-8de8-fff8236e5212 req-0da4afe6-4b8f-442d-9975-257eb96e1737 service nova] Creating event network-changed:6e292236-e930-4928-8ac9-c1257341443a for instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 on hv-cinder-84962 Jul 13 09:18:40.433484 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-a1d83f01-2db1-4035-8de8-fff8236e5212 req-0da4afe6-4b8f-442d-9975-257eb96e1737 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030404 Jul 13 09:18:40.433484 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 530/1098] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:18:40.436579 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:40.437721 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:40.444779 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:40.445246 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:40.446025 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:40.446672 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:40.579738 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:40.587314 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0e13f19f-acbb-430b-b7cd-372cfd1a7dfa tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.154538 Jul 13 09:18:40.587890 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 569/1099] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:40 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:41.604642 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:41.605315 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:41.616435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:41.616435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:41.616435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:41.616435 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:41.744472 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:41.753465 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-534fdae9-8283-4ce4-bd89-656fc9587fca tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.153085 Jul 13 09:18:41.754072 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 531/1100] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:41 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:42.771559 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:42.772167 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:42.778802 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:42.779243 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:42.780000 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:42.780425 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:42.909571 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:42.916914 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-64e7149d-f3ee-4af2-90c5-58170fed1b12 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.150175 Jul 13 09:18:42.917476 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 570/1101] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:42 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:43.934214 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:43.934824 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:43.941614 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:43.942077 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:43.942840 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:43.943275 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:44.075467 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:44.083487 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-481d9681-512d-473b-8807-a409236c6086 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.153146 Jul 13 09:18:44.084044 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 532/1102] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:43 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:45.100918 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:45.101534 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:45.108113 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:45.108563 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:45.109319 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:45.109753 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:45.239263 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:45.246623 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-e62b2c4c-1f1a-4ab0-b1c1-f25fa324459e tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.149617 Jul 13 09:18:45.247188 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 571/1103] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:45 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:46.263816 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:46.264416 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:46.271167 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:46.271606 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:46.272357 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:46.272786 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:46.400392 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:46.407686 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-c45841e5-18de-4b7d-8f89-1e2d7b716325 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.147707 Jul 13 09:18:46.408248 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 533/1104] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:46 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:46.987710 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-31df3d00-17c1-4b94-bea9-5aaef0d7bdf8 req-1c800506-163c-4d1d-b18e-01e3ef270dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3186bab8-b4eb-4837-96f2-6ebfc27c32e2", "name": "network-vif-plugged", "status": "completed", "tag": "6e292236-e930-4928-8ac9-c1257341443a"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:46.996491 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-31df3d00-17c1-4b94-bea9-5aaef0d7bdf8 req-1c800506-163c-4d1d-b18e-01e3ef270dc3 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:46.996935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-31df3d00-17c1-4b94-bea9-5aaef0d7bdf8 req-1c800506-163c-4d1d-b18e-01e3ef270dc3 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:47.007970 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-31df3d00-17c1-4b94-bea9-5aaef0d7bdf8 req-1c800506-163c-4d1d-b18e-01e3ef270dc3 service nova] Creating event network-vif-plugged:6e292236-e930-4928-8ac9-c1257341443a for instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 on hv-cinder-84962 Jul 13 09:18:47.012790 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-31df3d00-17c1-4b94-bea9-5aaef0d7bdf8 req-1c800506-163c-4d1d-b18e-01e3ef270dc3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029558 Jul 13 09:18:47.013374 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 572/1105] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:18:47.424584 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:47.425188 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:47.427197 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:47.427878 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=6 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:47.433135 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:47.433574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:47.434364 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:47.434799 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:47.566098 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:47.573466 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-d5f3a01c-1e86-40a8-a472-8a6a04cafa3c tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.153054 Jul 13 09:18:47.574019 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 534/1106] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:47 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:48.588274 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:48.599143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:48.599143 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:48.599832 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:48.600284 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:48.601040 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:48.601469 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:48.734110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:48.741889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3f184b54-c01d-4327-bb1b-73e2ec2602b3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1313 microversion: 2.1 time: 0.154555 Jul 13 09:18:48.742485 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 573/1107] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:48 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:49.760016 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:49.760637 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:49.762964 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:49.767833 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:49.768286 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:49.769053 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:49.769488 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:49.772148 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:49.898641 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:49.905815 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-8264585f-7a31-4b0d-a83c-522ffd30cfb1 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1497 microversion: 2.1 time: 0.149763 Jul 13 09:18:49.906415 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 535/1108] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:49 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:50.583751 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:50.584291 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:50.590834 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:50.591344 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:50.592109 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:50.592585 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:50.618004 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Going to try to terminate instance {{(pid=118252) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:18:50.998400 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-802b0785-6a46-49ff-9b3b-0088638fa643 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 204 len: 0 microversion: 2.1 time: 0.418839 Jul 13 09:18:50.998993 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 574/1109] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:18:50 2022] DELETE /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:18:51.008285 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:51.009039 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:51.016433 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:51.016886 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:51.017676 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:51.018140 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:51.148667 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:51.156106 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-dce903a5-3c07-4105-91eb-6a394bad04f3 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1503 microversion: 2.1 time: 0.152761 Jul 13 09:18:51.156680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 536/1110] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:51 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:52.174875 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:52.175627 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:52.182233 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:52.182678 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:52.183456 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:52.183889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:52.317318 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:52.325042 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-ac563147-1ba8-4269-8224-88768ab3ce1b tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1503 microversion: 2.1 time: 0.154419 Jul 13 09:18:52.325610 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 575/1111] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:52 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:18:52.844530 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-79cbabbb-6cc8-4b28-843d-57c4f1bd919b req-4c68d9a1-457e-4223-b439-9ea0acd24bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3186bab8-b4eb-4837-96f2-6ebfc27c32e2", "name": "network-vif-deleted", "tag": "6e292236-e930-4928-8ac9-c1257341443a"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:18:52.853439 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-79cbabbb-6cc8-4b28-843d-57c4f1bd919b req-4c68d9a1-457e-4223-b439-9ea0acd24bf4 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:52.853871 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-79cbabbb-6cc8-4b28-843d-57c4f1bd919b req-4c68d9a1-457e-4223-b439-9ea0acd24bf4 service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:52.865436 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-79cbabbb-6cc8-4b28-843d-57c4f1bd919b req-4c68d9a1-457e-4223-b439-9ea0acd24bf4 service nova] Creating event network-vif-deleted:6e292236-e930-4928-8ac9-c1257341443a for instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 on hv-cinder-84962 Jul 13 09:18:52.870625 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-79cbabbb-6cc8-4b28-843d-57c4f1bd919b req-4c68d9a1-457e-4223-b439-9ea0acd24bf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029750 Jul 13 09:18:52.871298 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 537/1112] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:18:53.341851 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:53.342496 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:53.349223 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:53.349667 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:53.350453 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:53.350889 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:53.369148 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:18:53.382533 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:53.382981 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:53.383422 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.objects.instance [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lazy-loading 'fault' on Instance uuid 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 {{(pid=118252) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:18:53.423219 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043c93f3631a458d98654fae9140807a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c88f502a46e0bf36ce97e86398ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:18:53.431099 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-1a4ac5a1-abe2-49ee-8242-2b5e14610372 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 200 len: 1303 microversion: 2.1 time: 0.093102 Jul 13 09:18:53.431654 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 576/1113] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:53 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:18:54.449562 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:18:54.453544 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] [instance: 3186bab8-b4eb-4837-96f2-6ebfc27c32e2] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:18:54.456383 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:54.456905 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:54.457672 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:18:54.458139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:18:54.471567 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.wsgi [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] HTTP exception thrown: Instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 could not be found. Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Request method failure captured: Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: request: GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 HTTP/1.1 Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept: application/json Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Accept-Encoding: identity Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Connection: close Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Length: 0 Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Content-Type: application/json Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Host: 10.222.0.40 Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Openstack-System-Scope: None Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: User-Agent: python-urllib3/1.26.9 Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Auth-Token: gAAAAABizo3ZhmFsFPWaDmssdY58kLcgtnobnWeAKhkHq6kK3q1t6Kr4zxlxyw0Xb4Z_1-zWGG9YNnVuNySwH5agIvqBmg5jEmsAg4k0psepzFd6uRmy3e69-ZydAVRGCVNeDyZ_s4DtY-K_l3_Pbj_jUvX11CmZ_DAhp0rwqJUcWVrtSMFeBe8 Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Id: None Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Domain-Name: None Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Identity-Status: Confirmed Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Is-Admin-Project: True Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Id: default Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Domain-Name: Default Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Id: 8a83c88f502a46e0bf36ce97e86398ce Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Project-Name: tempest-VolumesActionsTest-1432956727 Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Role: reader,member Jul 13 09:18:54.473611 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Roles: reader,member Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a83c88f502a46e0bf36ce97e86398ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant: tempest-VolumesActionsTest-1432956727 Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Id: 8a83c88f502a46e0bf36ce97e86398ce Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-Tenant-Name: tempest-VolumesActionsTest-1432956727 Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User: tempest-VolumesActionsTest-1432956727-project Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Id: default Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Domain-Name: Default Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Id: 043c93f3631a458d98654fae9140807a Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: X-User-Name: tempest-VolumesActionsTest-1432956727-project Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: method: > Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: exception: Instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 could not be found. Jul 13 09:18:54.475083 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: action_args: {'id': '3186bab8-b4eb-4837-96f2-6ebfc27c32e2'} Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 could not be found. Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:18:54.476200 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 could not be found. Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 could not be found. Jul 13 09:18:54.477980 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: ERROR nova.api.openstack.wsgi Jul 13 09:18:54.479321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] Returning 404 to user: Instance 3186bab8-b4eb-4837-96f2-6ebfc27c32e2 could not be found. {{(pid=118253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:18:54.479321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-7bfe86d9-7cd5-4f30-a72e-4152cf55ce42 tempest-VolumesActionsTest-1432956727 tempest-VolumesActionsTest-1432956727-project] 10.222.0.40 "GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2" status: 404 len: 111 microversion: 2.1 time: 0.030307 Jul 13 09:18:54.479321 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 538/1114] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:18:54 2022] GET /compute/v2.1/servers/3186bab8-b4eb-4837-96f2-6ebfc27c32e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:19:22.419965 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1203670173", "imageRef": "89c9919c-50a9-4fb5-be05-0b8edbdc2e13", "flavorRef": "452"}} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:19:22.425910 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:19:22.471011 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.network.neutron [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] validate_networks() for None {{(pid=118252) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 13 09:19:22.736470 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Flavor limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 09:19:22.736894 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Image limits 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 09:19:22.737371 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Flavor pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 09:19:22.737779 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Image pref 0:0:0 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 09:19:22.738222 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.virt.hardware [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118252) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 09:19:22.749033 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:22.749482 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:22.750316 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:22.751007 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:22.768513 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Getting quotas for project cf90881aef9b4222bdd3ca3c3ea67fd9. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 13 09:19:22.772794 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.quota [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Getting quotas for user 78a178a38d1945c59876dad28ec73a66 and project cf90881aef9b4222bdd3ca3c3ea67fd9. Resources: {'ram', 'cores', 'instances'} {{(pid=118252) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 13 09:19:22.784317 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Going to run 1 instances... {{(pid=118252) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 13 09:19:22.787137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89c9919c-50a9-4fb5-be05-0b8edbdc2e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118252) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 13 09:19:22.907049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-105f0834-deac-4ae3-b572-70c35a542d44 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490895 Jul 13 09:19:22.907699 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 577/1115] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Jul 13 09:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 09:19:22.918293 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-74649ade-cf61-4192-b925-92c252a0395d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:22.919032 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-74649ade-cf61-4192-b925-92c252a0395d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:22.922483 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_api:SELECT=7 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:19:22.923379 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell1:SELECT=15 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:19:22.979874 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-74649ade-cf61-4192-b925-92c252a0395d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:22.989376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-74649ade-cf61-4192-b925-92c252a0395d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1215 microversion: 2.1 time: 0.072438 Jul 13 09:19:22.989376 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 539/1116] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:22 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:24.004404 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:24.005012 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:24.012191 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:24.012637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:24.013402 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:24.013856 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:24.075059 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:24.082544 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-bd82d0ff-f44b-40d7-ac90-2e6f810c5b09 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1219 microversion: 2.1 time: 0.082768 Jul 13 09:19:24.086357 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 578/1117] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:23 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:25.101848 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:25.102557 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:25.110647 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:25.111320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:25.112177 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:25.112610 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:25.221162 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:25.229048 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-fd044607-2af1-4698-a44d-1b7e00548a97 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1275 microversion: 2.1 time: 0.132984 Jul 13 09:19:25.229633 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 540/1118] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:25 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:26.246489 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:26.247104 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:26.253870 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:26.254366 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:26.255166 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:26.255602 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:26.390895 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:26.399759 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-10157842-4c9c-498b-a3c1-618c0401e923 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.157249 Jul 13 09:19:26.410137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 579/1119] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:26 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:27.224556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-37193eb5-cc2a-4948-8363-89c2d35e287b req-aa7fa069-97cb-4825-a230-e87ae7e09fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07", "tag": "1b370fb1-4d4d-4335-8a7d-a640454716a8"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:19:27.235422 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-37193eb5-cc2a-4948-8363-89c2d35e287b req-aa7fa069-97cb-4825-a230-e87ae7e09fba service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:27.235873 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-37193eb5-cc2a-4948-8363-89c2d35e287b req-aa7fa069-97cb-4825-a230-e87ae7e09fba service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:27.250916 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-37193eb5-cc2a-4948-8363-89c2d35e287b req-aa7fa069-97cb-4825-a230-e87ae7e09fba service nova] Creating event network-changed:1b370fb1-4d4d-4335-8a7d-a640454716a8 for instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 on hv-cinder-84962 Jul 13 09:19:27.256586 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-37193eb5-cc2a-4948-8363-89c2d35e287b req-aa7fa069-97cb-4825-a230-e87ae7e09fba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036647 Jul 13 09:19:27.257558 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 541/1120] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:19:27.417245 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:27.417797 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:27.424197 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:27.424643 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:27.425398 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:27.425829 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:27.559899 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:27.567469 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c60cb02d-d319-4a07-bce5-7b910a53105b tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.154091 Jul 13 09:19:27.568049 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 580/1121] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:27 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:28.585644 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:28.586361 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:28.592571 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:28.592958 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:28.593714 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:28.594172 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:28.721735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:28.729983 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-b00ba463-657a-48e5-9172-f86b1258a46f tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.149270 Jul 13 09:19:28.730576 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 542/1122] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:28 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:29.746462 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:29.747081 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:29.753839 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:29.754334 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:29.755867 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:29.756495 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:29.882086 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:29.889511 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-3012ae43-9d8d-4f5a-9a2b-4e8e993b02c5 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.146913 Jul 13 09:19:29.890211 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 581/1123] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:29 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:30.906351 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:30.906994 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:30.913372 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:30.913811 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:30.914593 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:30.915021 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:31.048058 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:31.055517 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-9156b65b-6eef-4910-8b76-d5b229315401 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.152979 Jul 13 09:19:31.063553 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 543/1124] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:30 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:32.072187 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:32.072798 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:32.079264 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:32.079714 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:32.080471 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:32.080906 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:32.213938 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:32.221339 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-64f3b671-0e8e-4249-baa4-a818975dd039 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.153022 Jul 13 09:19:32.221903 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 582/1125] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:32 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:33.212712 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [req-7b34197e-95d9-4f1e-b156-cb57653f9784 req-5ce98aac-b4a4-4885-9e81-0e1dd246fa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07", "name": "network-vif-plugged", "status": "completed", "tag": "1b370fb1-4d4d-4335-8a7d-a640454716a8"}]} {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:19:33.216832 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG dbcounter [-] [118253] Writing DB stats nova_cell0:SELECT=2 {{(pid=118253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:19:33.222114 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-7b34197e-95d9-4f1e-b156-cb57653f9784 req-5ce98aac-b4a4-4885-9e81-0e1dd246fa3b service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:33.222556 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [req-7b34197e-95d9-4f1e-b156-cb57653f9784 req-5ce98aac-b4a4-4885-9e81-0e1dd246fa3b service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:33.234131 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.compute.server_external_events [req-7b34197e-95d9-4f1e-b156-cb57653f9784 req-5ce98aac-b4a4-4885-9e81-0e1dd246fa3b service nova] Creating event network-vif-plugged:1b370fb1-4d4d-4335-8a7d-a640454716a8 for instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 on hv-cinder-84962 Jul 13 09:19:33.238769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:33.239860 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [req-7b34197e-95d9-4f1e-b156-cb57653f9784 req-5ce98aac-b4a4-4885-9e81-0e1dd246fa3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030966 Jul 13 09:19:33.240322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:33.240835 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 544/1126] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:19:33.242500 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=2 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:19:33.243214 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG dbcounter [-] [118252] Writing DB stats nova_cell0:SELECT=6 {{(pid=118252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:19:33.248595 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:33.251431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:33.251431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:33.251431 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:33.386306 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:33.394805 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-51a9c1d7-64c2-40fd-8e8b-ad8a8e675b01 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.159827 Jul 13 09:19:33.395406 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 583/1127] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:33 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 09:19:34.413257 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:34.413947 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:34.420735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:34.421183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:34.421950 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:34.422459 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:34.555574 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:34.563258 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-129306da-c9d7-46a7-aea1-534796ad8501 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1315 microversion: 2.1 time: 0.154886 Jul 13 09:19:34.563823 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 545/1128] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:34 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:35.579913 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:35.580522 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:35.587741 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:35.588188 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:35.588935 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:35.589361 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:35.719649 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:35.727110 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-dcb7fee8-6fbe-4221-9564-9e19cd979eb7 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1465 microversion: 2.1 time: 0.151395 Jul 13 09:19:35.727667 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 584/1129] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:35 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:35.766632 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:35.767128 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:35.773636 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:35.774124 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:35.774891 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:35.775329 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:35.799680 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Going to try to terminate instance {{(pid=118253) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 13 09:19:36.051528 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-60e45cc5-b6c0-4749-a14e-22f05d1d5960 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 204 len: 0 microversion: 2.1 time: 0.288298 Jul 13 09:19:36.052159 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 546/1130] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Jul 13 09:19:35 2022] DELETE /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 09:19:36.061020 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:36.061619 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:36.067711 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:36.068165 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:36.068956 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:36.069394 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:36.196363 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.policy [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118252) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:36.203769 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-c813dc96-a1aa-45b1-b6d9-f322c2ad6876 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1471 microversion: 2.1 time: 0.146782 Jul 13 09:19:36.204346 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 585/1131] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:36 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:37.222272 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:37.222962 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:37.230115 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:37.230559 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:37.231308 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:37.231735 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:37.400019 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:37.407588 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-eff74e7c-da5d-445f-a267-91fd2d51076d tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1471 microversion: 2.1 time: 0.189608 Jul 13 09:19:37.408163 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 547/1132] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:37 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:37.876448 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [req-3ea30860-f437-4ead-847d-97360f269eb0 req-2079ac1f-6a54-4aef-a14a-fbfbec9b613a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07", "name": "network-vif-deleted", "tag": "1b370fb1-4d4d-4335-8a7d-a640454716a8"}]} {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 09:19:37.885644 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-3ea30860-f437-4ead-847d-97360f269eb0 req-2079ac1f-6a54-4aef-a14a-fbfbec9b613a service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:37.888614 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [req-3ea30860-f437-4ead-847d-97360f269eb0 req-2079ac1f-6a54-4aef-a14a-fbfbec9b613a service nova] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:37.901596 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.compute.server_external_events [req-3ea30860-f437-4ead-847d-97360f269eb0 req-2079ac1f-6a54-4aef-a14a-fbfbec9b613a service nova] Creating event network-vif-deleted:1b370fb1-4d4d-4335-8a7d-a640454716a8 for instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 on hv-cinder-84962 Jul 13 09:19:37.906755 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [req-3ea30860-f437-4ead-847d-97360f269eb0 req-2079ac1f-6a54-4aef-a14a-fbfbec9b613a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034577 Jul 13 09:19:37.907367 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 586/1133] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 13 09:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 09:19:38.424852 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.api.openstack.wsgi [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:38.425460 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.compute.api [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118253) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:38.432348 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:38.432806 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:38.433565 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:38.433999 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:38.464280 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:38.464736 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG oslo_concurrency.lockutils [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:38.465183 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.objects.instance [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lazy-loading 'fault' on Instance uuid f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 {{(pid=118253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 13 09:19:38.507185 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: DEBUG nova.policy [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a178a38d1945c59876dad28ec73a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90881aef9b4222bdd3ca3c3ea67fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118253) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 09:19:38.514572 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO nova.api.openstack.requestlog [None req-0ac69fc6-585d-45a4-823f-f5ecbc8fc642 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 200 len: 1305 microversion: 2.1 time: 0.093785 Jul 13 09:19:38.515139 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: [pid: 118253|app: 0|req: 548/1134] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:38 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 09:19:39.540250 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Calling method '>' {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 09:19:39.541147 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.compute.api [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] [instance: f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07] Fetching instance by UUID {{(pid=118252) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 13 09:19:39.547467 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:39.547912 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:39.548661 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 13 09:19:39.549137 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG oslo_concurrency.lockutils [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Lock "85d294e0-0c88-42cf-b9fd-fab8c4554a28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 13 09:19:39.562842 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.wsgi [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] HTTP exception thrown: Instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 could not be found. Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Request method failure captured: Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: request: GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 HTTP/1.1 Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept: application/json Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Accept-Encoding: identity Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Connection: close Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Length: 0 Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Content-Type: application/json Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Host: 10.222.0.40 Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Openstack-System-Scope: None Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: User-Agent: python-urllib3/1.26.9 Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Auth-Token: gAAAAABizo4YA2KE1VH-M1tqPeeBUV_3UN8Ye6FRoPz-REDEpqFCNnns1vqzVj4s6qLFoe4FG2w80V6aMeCqJESAFJlj6J9dyG43bbGDSRrbUwwpTmhHd4F5Xvw5uHiyMAqYjJYN-IfelVcCewf_Sf2XFrUg2TlPhQPD6Pmfmkhl3xI9lFBL33U Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Id: None Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Domain-Name: None Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Identity-Status: Confirmed Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Is-Admin-Project: True Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Id: default Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Domain-Name: Default Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Id: cf90881aef9b4222bdd3ca3c3ea67fd9 Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Project-Name: tempest-VolumesNegativeTest-2087426774 Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Role: reader,member Jul 13 09:19:39.564438 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Roles: reader,member Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf90881aef9b4222bdd3ca3c3ea67fd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf90881aef9b4222bdd3ca3c3ea67fd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf90881aef9b4222bdd3ca3c3ea67fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf90881aef9b4222bdd3ca3c3ea67fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant: tempest-VolumesNegativeTest-2087426774 Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Id: cf90881aef9b4222bdd3ca3c3ea67fd9 Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-Tenant-Name: tempest-VolumesNegativeTest-2087426774 Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User: tempest-VolumesNegativeTest-2087426774-project Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Id: default Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Domain-Name: Default Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Id: 78a178a38d1945c59876dad28ec73a66 Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: X-User-Name: tempest-VolumesNegativeTest-2087426774-project Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: method: > Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: exception: Instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 could not be found. Jul 13 09:19:39.566322 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: action_args: {'id': 'f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07'} Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: {{(pid=118252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 could not be found. Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 13 09:19:39.567325 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 could not be found. Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 could not be found. Jul 13 09:19:39.569090 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: ERROR nova.api.openstack.wsgi Jul 13 09:19:39.570531 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: DEBUG nova.api.openstack.wsgi [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] Returning 404 to user: Instance f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 could not be found. {{(pid=118252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 13 09:19:39.570531 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO nova.api.openstack.requestlog [None req-0a464709-5031-4ee1-ae5f-4347aae8c1d8 tempest-VolumesNegativeTest-2087426774 tempest-VolumesNegativeTest-2087426774-project] 10.222.0.40 "GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07" status: 404 len: 111 microversion: 2.1 time: 0.031369 Jul 13 09:19:39.570531 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: [pid: 118252|app: 0|req: 587/1135] 10.222.0.40 () {58 vars in 1235 bytes} [Wed Jul 13 09:19:39 2022] GET /compute/v2.1/servers/f1e0afd6-8f46-48b6-9b90-3dc7e4dffc07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 09:21:08.020578 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:21:08.021282 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Wed Jul 13 09:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:21:18.910724 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:21:18.911300 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Wed Jul 13 09:21:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:21:36.123669 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:21:36.124320 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Wed Jul 13 09:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:22:06.592818 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:22:06.593390 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Wed Jul 13 09:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:24:28.029177 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:24:28.029800 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Wed Jul 13 09:24:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:24:38.262975 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:24:38.263637 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Wed Jul 13 09:24:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:24:38.918750 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:24:38.919249 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Wed Jul 13 09:24:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:24:56.132600 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:24:56.133311 dv-cinder-849626-3-iscsi devstack@n-api.service[118253]: Wed Jul 13 09:24:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 09:24:56.516628 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 09:24:56.517149 dv-cinder-849626-3-iscsi devstack@n-api.service[118252]: Wed Jul 13 09:24:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!